The Glories of User Testing: Chicago Early Learning

In late 2012, after a short development process, we launched an initial version of our project called Chicago Early Learning.

Chicago Early Learning

The first manifestation of a search results page for ChicagoEarly Learning.

An active regime of testing

Then, in the ensuing months, we actively listened to regular Chicago residents, dutifully noted their feedback, and directly changed the site so that it worked better for our target audience of Chicago parents and guardians looking for early childhood education. Here’s a review of the process and the results.

CPS Head Start Policy Committee Meeting

We showed the site on a typical computer set up inside a Chicago Public School location.

CPS Head Start Policy Committee Meeting

We demonstrated the site at a CPS Head Start Policy Committee Meeting At Zenos Colman Elementary School, 4650 S. Dearborn.

Presenting the Early Childhood Portal as 37th Ward Alderman Emma Mitts Looks On

We presented the site to block club leaders inside the ward office of as 37th Ward Alderman Emma Mitts.

User Testing, Chicago Early Learning

We also tested the site in formal environments inside Action for Children locations in Chicago.

Changes to the site based on user feedback

Softer, less map-y design

We completely overhauled the look & feel of the site, making it softer and more rounded. Lots of users we talked to had childcare needs in different areas of the city or related to different parts of their lives (home, work, and relatives, for instance).  For this reason, we also moved away from a stark search box and toward explanations of how to approach the site. We added explanatory text that short-circuited the most common question.  We also moved from book imagery to a crayon/ marker in the logo to better reflect the programs that parents were looking for.

Chicago Early Learning, Relaunch, September 2013

More prominent text feature

The text feature, which allows residents to text a zip code to a special number and receive a set of nearby location, was very popular in testing. We did notice that texting was hidden in the navigation, so we added a paragraph highlighting the feature. We also made the text phone number easier to see and share by giving it a separate page with a separate URL.

Text feature on Chicago Early Learning

Improved search that helped you along

We saw that many people started off their search with a location in mind, whether it was a school or a neighborhood. We moved away from a pure address search and now pre-populate the search box as the user types. This short-circuits the search process and makes people immediately feel like this is a place that has what they’re looking for. The “Browse by community” function provides another way for people to dive in without putting in an exact address.

Chicago Early Learning Search for "kid"

Improved filtering for more user control

We found in testing that people did not know how to easily drill down into search results and they very rarely used the filtering feature. We made the filtering more prominent and took up much more screen real estate with details of the search results. Previously, the user had to click on a particular item on the map to reveal details. An overall insight we observed from testing was that the map is not the thing—the details of early learning centers was the thing. We changed the interface to reflect this.

Chicago Early Learning Search

Better comparisons– more locations, easier to share

One thing we heard loud and clear from parents was that they wanted to be able to compare more than two locations. In response, we completely changed the comparison system—changing it to a more recognizable star / favorite system, displaying starred items in a grid, and giving the user the flexibility to easily add and remove locations.

Chicago Early Learning Compare

Admin tool for management beyond the spreadsheet

An important milestone in this reporting period is the creation of an easy-to-use admin tool to manage all of the locations. Previously, the site was run by a “magic spreadsheet” that was difficult to manage. The Django admin interface to the rescue!

Site administration   Chicago Early Learning Portal adminThe admin search tool allows you to drill down quickly

Select location to change   Chicago Early Learning Portal admin

And location detail pages are managed through a simple web form

Change location   Chicago Early Learning Portal admin benedict

Conclusion

The process of engaging Chicago residents with this tool has been very rewarding. Since we started this project– and in part based on what we learned here– we started the CUTGroup, a set of regular Chicago residents who get paid to test civic apps. This kind of back-and-forth helps developers, government, and residents communicate with each other and make our lives better.

The Chicago Early Learning Portal: A One-Stop Shop to Find Important Data About Chicago’s Early Childhood Programs (Azavea Journal)

The Chicago Early Learning Portal: A One-Stop Shop. Snip:

An interesting challenge the design team will face in the upcoming work will be to refine the SMS interface to the application. During the usability tests and demos of the application, we’ve received a lot of excited feedback about this feature. It provides a way for users to access the data behind the application by sending and receiving text messages. There is a dearth of resources that describe good user experience (UX) design in the realm of SMS interfaces, so through the examination of existing SMS products and iterative redesign, we are looking forward to learning some of the tricks to creating a great SMS user experience.

 

Chicago Launches Website to Help Parents Find Preschool Programs (Education Week)

Here’s an article about Chicago Early Learning in Education Week.

Snip:

The website, complete with an interactive map, helps parents find neighborhood options by entering their addresses and provides information so they can compare programs. A texting feature is available so parents can get information on their phones without having to access the Internet. The site also notes which programs are “accredited through the National Association for the Education of Young Children and will eventually include information about each program’s statewide rating once the Illinois Quality Rating Improvement System is launched,” the release say

The Launch of Chicago Early Learning

Today marked the launch of Chicago Early Learning, a new way to find and compare early learning programs in Chicago.

Here’s some snips from the press release from the Mayor’s Office:

As part of the his administration’s focus on increasing access to quality early learning programs for children across the city and emphasis on helping parents get and stay involved in their children’s education, Mayor Rahm Emanuel today launched a new online Early Leaning Portal, www.chicagoearlylearning.org. The portal is an easy-to-use, interactive website that puts information about hundreds of quality early learning programs across the city all in one place.

*

“We were happy to collaborate with the City on this interactive map, which will allow parents and families to find information about these programs easily and quickly. We’re interested in hearing from parents and caregivers on what would make the site more useful to them,” said Dan O’Neil, Executive Director of the Smart Chicago Collaborative. “We’re also releasing the code for the site as open source, so that it can be used to make similar map-based sites showing resources across the city.”

“Our focus is on making sure children are ready to learn when they enter kindergarten. M.K. and I share Mayor Emanuel’s strong commitment to providing high-quality early learning for infants, toddlers and their families,” said J.B. Pritzker, president of the J.B. & M.K. Pritzker Family Foundation. “Helping Chicago parents and caregivers identify the best early childhood educational opportunities in their neighborhoods is critically important. This online interactive, one-stop shop will help parents and caregivers access and better manage the challenging process of selecting a high-quality early learning program for their infants and toddlers.”

Here’s the code that drives the site.

Chicago Early Learning

Here’s a spot on CBS about the site featuring Kevin Hauswirth of the Mayor’s Office:

Review of Chicago Early Learning Portal on CBS with Kevin Hauswirth from Daniel X. O’Neil on Vimeo.

We worked with a really great team to get this first phase of the Web site launched:

  • At Smart Chicago, we had consultant Derek Eder of DataMade. Derek served as local technical technical project manager and was instrumental in getting the data for the site in good order
  • Azavea, a leading geospatial firm out of Philadelphia, did the heavy lifting around technology
  • The Urban Education Lab of the University of Chicago shepherded the project from the education perspective and worked with other stakeholders like Illinois Action for Children to make sure that the data was sound and the interface was useful key constiuents

We look forward to working toward a successful phase two, which will incorporate feedback from user testing we’ll be conducting in the months to come. Questions, comments, and feedback are always welcome at info@chicagoearlylearning.org

Mayor’s Office Press Release on the Launch of Chicago Early Learning

Mayor Emanuel Unveils Online Early Learning Portal to Help Parents and Families Find Quality Programs for Children in Their Neighborhoods: Mayor’s Office press release on the initial launch. Snip:

“We were happy to collaborate with the City on this interactive map, which will allow parents and families to find information about these programs easily and quickly. We’re interested in hearing from parents and caregivers on what would make the site more useful to them,” said Dan O’Neil, Executive Director of the Smart Chicago Collaborative. “We’re also releasing the code for the site as open source, so that it can be used to make similar map-based sites showing resources across the city.”

Request for Letters of Interest for an Early Childhood Portal

The Smart Chicago Collaborative and the University of Chicago’s Urban Education Lab are seeking letters of interest for the design and development of an early childhood education web portal for the City of Chicago.

In order to increase transparency and empower parents, the City of Chicago is partnering with the Smart Chicago Collaborative and the University of Chicago’s Urban Education Lab (UEL) to develop a comprehensive early childhood education web portal. The portal will serve as a one-stop-shop for finding early learning programs, assessing program quality, and tracking data about Chicago’s early childhood systems. With the implementation of the State’s Quality Rating Improvement System (QRIS), parents will be able to view each program’s star rating to assess quality across the city. The portal will also help parents understand their child’s eligibility for program, and allow for user interaction/input regarding programs. The portal will be fully operational by the end of July 2012, in time for parents to use it as a resource for the next school year.

This request for letters of interest is the first step in the process of finding a vendor, consultant, or group of consultants for the design and development of the web portal. We are looking for letters of interest that demonstrate an aptitude for and experience in this type of work, as well as some initial thoughts on how to execute it. We welcome letters from design firms, technology outfits, and independent developers who have ideas on how to get this done. The Web Portal Design partner for this project will be required to:

  • Work at the direction of the Smart Chicago Collaborative.
  • Work with researchers affiliated with the University of Chicago Urban Education Lab who will provide input on content, how it is presented, and the possible incorporation of experiments aimed at trying to learn about how to make the portal as helpful to parents as possible, and to better understand the decision making of low-income parents around schooling and related issues.
  • Discovery: Discuss goals, objectives, and methodology. Become familiar with all relevant information to design the best possible system, including reviewing all existing school lookup tools in Chicago (CPS School Finder, SchoolLocator, ArtLook), similar tools in other jurisdictions, and commercial options.
  • Development: Be open to using as much open source code as possible.
  • Wireframes: Create the best possible user experience with thoughtful attention to user flows, the feel of the application, and creating a real community around the information.
  • Design: Engage in a classic graphic design process for the portal, including logo, colors, themes, etc.
  • Mapping: Develop a mapping system, using as much open source code as possible
  • Commenting: Develop a commenting system to encourage the sharing of the most reliable information possible within the site

In the letter of interest, applicants should demonstrate experience, aptitude, and capacity in relation to the work described above. In addition, applicants should provide an estimated project timeline and a budget proposal. Letters of interest should not exceed three single-spaced pages, including budget and timeline information, and should be submitted to Dan O’Neil at DONeil@cct.org. Brief bios, CVs, or resumes for key personnel should be submitted with letters of interest and will not be included within the three page limit. Letters are due April 13, 2012.

Download this document as a PDF.