Route evaluations

A route evaluation of a cycle superhighway is a comprehensive assessment of the route’s effects and of whether the objectives of the cycle superhighway have been achieved.

The Cycle Superhighway Collaboration in the Capital Region has developed guidelines for which measurements should be conducted and which methods should be used. This ensures that results can be compared before and after construction, across routes, and in the subsequent development over time.

Evaluation objectives

In the development of a route evaluation, several objectives are often formulated.

The objectives of the Cycle Superhighway Collaboration in the Capital Region are linked to the collaboration’s quality goals for a cycle superhighway: Coherency, accessibility, comfort, safety, and security.

In the following, the typical objectives under each quality goal that are included in a cycle superhighway evaluation are described, along with the methods used to asses them.

Objectives for the five quality goals

Coherency

Coherency involves ensuring better connectivity between business- , educational-, and residential areas as well as public transportation hubs. The objectives aim to increase the number of users and their satisfaction.

ParametersExpected resultsMethods
Increase in cycling traffic10-20 % increase in cycling trafficMachine counts of cyclists (tube counts, measured in average weekday daily traffic)
Modal shift from other modes of transport to cyclingMinimum 10 % of new cyclists on the route has shiftet mode from cars to bicyclesStop-interviews
Satisfaction with connection to public transportSatisfaction is valued as a minimum 4 on a scale of 1-5, where 5 is the maximum level of satisfaction. Stop-interviews

Accessibility

Accessibility is about making it easy to get around. Objectives for accessibility typically involve reducing ‘stop time’ and ensuring high user satisfaction with maintaining a steady speed.

ParametersExpected resultsMethods
Satisfaction with the possibility to upkeep a steady paceSatisfaction is valued as a minimum of 4 on a scale of 1-5, where 5 is the maximum level of satisfactionStop-interviews
Improved ‘stop time’ and stop frequenceLess minutes in stop og less stops at junctions (less stop frequences)Measurement of traveling time and stop frequency (Cycle-throughs on three types of cycles)

Comfort

Comfort particularly involves the quality of the pavement and a high level of operation and maintenance, so the objectives for this typically revolve around pavement assessments – both through measurement equipment and user satisfaction.

Recommended objectives:

ParametersExpected resultsMethods
Measurement of pavement quality shows improvement or comfortMinimum 80 % of the pavement on the stretch is categorised as medium-level or high-level comfortMeasurement of comfort (Cycle-through with measurement equipment mounted on a test-bike)
Satisfaction with the pavement on the routeSatisfaction is valued as a minimum of 4 on a scale of 1-5, where 5 is the maximum level of satisfactionStop-interviews

Safety

The objective of a safe route is to minimize the risk of accidents and collisions – both between cyclists and other road users, between cyclists themselves, and solo accidents. Police-reported accidents are assumed to represent only 14% of all cyclist accidents1Christiansen, H., & Warnecke, M-L: Risiko i trafikken 2007-2016, 2018. Link, so it can be difficult to assess the actual safety of a route based on this data alone. Therefore, it is recommended to rely on users’ own reports.

Recommended objectives:

ParametersExpected resultsMethods
Percentage of users who indicate they have experienced accidentsMaximum 2 % of respondents have been involved in an accident in the past yearStop-interviews

Security

Security regards the users’ own sense of security. Therefore, objectives for this focus on users’ experience and satisfaction.

Recommended objectives:

ParametersExpected resultsMethods
Satisfaction with security on the routeSatisfaction is valued as a minimum of 4 on a scale of 1-5, where 5 is the maximum level of satisfactionStop-interviews

Timeline for route evaluations

When a new cycle superhighway is being planned, or if major upgrades are planned for an existing route, the evaluation of the project must be considered and planned well in advance.

A cycle superhighway route evaluation consists of a pre-assessment and a post-assessment. There are often several years between these assessments, but they are carried out at the same time of the year to ensure comparability. To avoid holidays and summer/winter extremes in weather conditions, which can affect cycle traffic, measurements are typically conducted in September.

The measurements for the pre-assessment is conducted in September before construction begins to establish a baseline. The post-assessment should be conducted again in September 1-1.5 years after the route has been launched as a cycle superhighway. Ideally, there should be at least one year between the launch and the evaluation to ensure that users have had time to discover and adapt to the upgrades on the route, and the effects on cycle traffic, safety, and satisfaction can begin to be observed.

The Cycle Superhighway Collaboration in the Capital Region always seeks external assistance to conduct route evaluations to maintain a degree of independence in the results and assessment of the route. The collaboration has been conducting route evaluations since 2010, starting with the evaluation of the first route, the Albertslundruten. Most of the same parameters are evaluated today as back then, but some methods have been adjusted and refined over the years as experience grow and new technologies are developed.

After the route evaluation is completed, the route is monitored annually through bicycle counts every September and route inspections to track the development of cycle traffic and the condition of the cycle superhighway

Methods for evaluations

Many methods can be used to measure the effectiveness and impact of cycle superhighways, and they are continually evolving. Most methods have advantages and disadvantages, which is why it’s important to carefully consider the choice of method.

Most importantly, the method is durable enough to be used in both a pre-assessment and a post-measurement several years later.

Based on experience with different route evaluation methods, the Cycle Superhighway Collaboration in the Capital Region utilizes the following methods for route evaluations of the Capital Region’s cycle superhighways.

Evaluation methods

Bicycle counts

The bicycle counts are conducted as automated bicycle counts (using pneumatic tube counters) evenly distributed along the route, with at least one counting location in each municipality or approximately 3-4 km between each counting location. Counts are typically conducted during the first week of September, always at the same time of year and at the same counting locations in both the pre- and post-evaluations, to ensure the best possible basis for comparison. Bicycle counts on cycle superhighways are always reported in UHDT (week day average daily traffic).

It is recommended that counts are logged in Mastra.

Comfort measurements

Comfort measurements are conducted by cycling through the route with measuring equipment (accelerometers) mounted on a test bike. The cyclist positions themselves as close as possible to where other cyclists typically ride on the path. The smoothness of the surface is measured by the number and size of vibrations recorded. The accelerometer measures vertical acceleration five times per second while simultaneously recording the GPS position once per second.

The route is cycled through five times in each direction. Based on these five runs, the results are presented as an average per 10 meters using digital maps with color-coding indicating sections categorized as good asphalt, moderately good asphalt, moderate asphalt quality, and poor asphalt quality.

Measurement of travel time and stop frequency

To conduct a travel time measurement, the route is cycled through using three types of bicycles: regular bike, e-bike, and speed pedelec.

During the cycling with each type of bike, the following speeds are attempted to be maintained: regular bike (20 km/h), e-bike (25 km/h), and speed pedelec (35 km/h).

The measurement is repeated on each type of bicycle five times in each direction. Subsequently, the total stop time on the route and the frequency of stops at the route’s intersections can be measured.

Accident recordings

In the planning of a cycle superhighway, it can be a good idea to gather information on police-recorded accidents for the past minimum of 5 years to map potentially accident-prone areas along the route. This registration can advantageously be included in the pre-evaluation.

The reason police-recorded accidents are no longer part of a standard evaluation of a cycle superhighway is that the accident numbers are relatively small, and more than one year’s registration (preferably five years) should ideally be collected at the post-measurement to avoid significant statistical uncertainty. Additionally, studies show that the police-recorded accidents involving bicycles represent only 14% of all cycling accidents2Christiansen, H., & Warnecke, M-L: Risiko i trafikken 2007-2016, 2018. Link. In other words, this method struggles to evaluate the actual accident development on the route.

Therefore, evaluations of cycle superhighways now rely on users’ own reports. This method also carries a high level of statistical uncertainty but is expected to more accurately reflect the proportion of commuters who have experienced accidents on the route.

User questionanaire survey

User questionanaire surveys are performed to get insights into user’s experience of cycle superhighways.

In the Cycle Superhighway Collaboration in the Capital Region, it is agreed that there should be an aim of a minimum of 400 respondents per evaluation as a starting point to have a data foundation that is statistically valid.

To reach the target group of the cycle superhighways, which are commuters, a questionnaire surveys among users are conducted during rush hours between 7-9 AM in the morning and between 3-5 PM in the afternoon. The surveys are conducted at relevant locations distributed along the route. Often, this location can be at a ‘natural’ stop, such as an intersection, where the users stop or slow down anyway, so they are not interrupted in the middle of a stretch. In some cases, there may be selected locations where special measures or improvements have been made, where it may also be relevant to conduct questionnaires.

Since it can be difficult to find time to conduct a full questionnaire with users during rush hours, commuters are offered the opportunity to answer an online questionnaire. They do this by providing their contact information (email-address), after which they receive a link to the survey, which they can fill out at a convenient time. Users will be asked to answer the questions in regards to the trip they made when they were asked to participate in the survey. This method has shown great response rate.

The user questionnaire surveys are intended to shed light on the user’s experience of the route, satisfaction level, reasons for choosing it, and more. It’s important that the questions framework is relatively fixed and follows the same content in both pre- and post-assessments. This way, the results from the survey can be used to paint a picture of the current route users and their satisfaction. At the same time, the data can also be used to compare across multiple routes and provide an overall picture for all the routes.

Examples of questions for route evaluations:

  • Why did you take this route?
  • What was the purpose of the trip?
  • What type of bicycle did you use?
  • Did you combinde with other modes of transport during your trip? If so, which?
  • How long was your trip?
  • Where did your trip start/end?
  • How often do you use the route?
  • Have you ever used other routes as an alternative?
  • Do you consider yourself as a new cyclist? If yes, what prompted you to start cycling the route and what did you do before?
  • How often do you practice follpwing modes of transportation; walking, cycling, driving car, public transportation, other
  • How safe do you feel as a cyclist on the route?
  • If feeling unsafe or very unsafe, please describe what would make you feel safe?
  • Have you, as a cyclist, been involved in an accident on the route in the past year/the past 2 years (depending on how long after the route launch the post-measurement is performed)?
  • If yes to accidents, where, when, what happened?
  • How satisfied are you with the following aspects: pavement, waiting time at intersections, signage, lighting, vegetation trimming
  • How easy was it to maintain a steady speed on the route?
  • If it was difficult or very difficult, please describe what would make it better?
  • What is your overall satisfaction with the route?
  • Do you have any desired improvements on the route?
  • Do you know about cycle superhighways and other routes?
  • Other questions regarding user’s gender, age, and municipality of residence

Before- and after photos

It’s a good idea to have before and after pictures of the installations and improvements made on the cycle superhighway. This way, it becomes possible to clearly demonstrate the specific improvements that have been made to the route.

Before and after pictures are an important part of communicating the route’s development and impact.

Example of before and after pictures from the Jyllinge-Stenløseruten. Pictures from the route’s evaluation report prepared by Viatrafik for the Cycle Superhighway Collaboration, 2021.

Good advices

Incorporate evaluation already in the planning phase

To conduct a proper evaluation, it’s important to have carried out consistent measurements both before and after the establishment of the cycle superhighway, so that there is a good basis for comparison. Therefore, the route evaluation should be incorporated already in the planning phase of the cycle superhighway establishment.

Prelimenary measurements for part of a strecht on a planned cycle superhighway

In some cases, a cycle superhighway is built in stages instead of the entire route being constructed at once. In these cases, it’s still important to have a prelimenary assessment of the entire cycle superhighway route. Such assessment should at least include measurements as bicycle counts and photographs before and after the upgrade. Depending on the type of infrastructure being established, user questionnaire surveys, comfort measurements, and travel time and stop frequency measurements may also be relevant.

Example of an evaluation plan for a cycle superhighway

Planning of a cycle superhighwayEvaluation plan is developed. External consultant is assigned the evaluation task.
Pre-assessment Counts in the first week of September, as well as travel time measurements, comfort measurements, and stop interviews, are conducted before construction work begins.
Construction phase__________
Launch__________
Post-assessment1 – 1.5 years after the launch, the post-evaluation takes place in the same period as the pre-evaluation. Counts in the first week of September (always the same period as the pre-evaluation), as well as travel time measurements, comfort measurements, and stop-interviews are conducted.
Route evaluationA route evaluations report is commenced on the bases of the pre- and post-assessment.
Additional measurements and examinationsFor example, if new bicycle parking is installed near a cycle superhighway path and station, or if new solutions are being tested in a development project—such as information pylons or countdown signals.
Yearly monitoring and route inspectionsAnnual counts take place subsequently at the same locations every year during the first week of September. The routes are inspected annually in the spring, where they are cycled through by a route inspector.

References

  • Christiansen, H., & Warnecke, M-L: Risiko i trafikken 2007-2016, 2018. Link.