All about the content, calculations, and composition of the LENA Grow Impact Report, how to access it, and how to set it up to display the data of importance to you
Click to jump to a topic, or use Ctrl+F to search this article.
| Access |
| Take a Tour of the Impact Report |
| By the Numbers |
| Child Impact: All Children |
| Child Impact: Equity |
| Teacher-Reported Impact |
| Set Up the Impact Report |
| Data Inclusion Rules |
| Pre/Post Calculations |
Access
LENA Online Account Owners can access this report by selecting Account Overview in the LENA Online menu on the left and then clicking View Reports on the top right.
From here, choose which pages, dates, sequence type, and sites you want to include, and click Refresh Report.
Then click Print Selected Reports to print a hard copy or to print to PDF.
Take a Tour of the Impact Report
Designed with stakeholders in mind, the Impact Report describes LENA Grow, defines turns, explains the importance of interactive talk, and displays your program’s outcome data within that context to show your program’s influence on the communities you serve.
Two additional pages offer further insight into which groups and children met criteria for impact evaluation.
Read on to learn what each section of the report shows.
By the Numbers
The By the Numbers section shows the scope of your program’s impact in the date range you specify.
Use this section to view:- Your "number served" for classrooms, children, and teachers.
- The number of classrooms and children whose participation in LENA Grow was sufficient for impact evaluation.
- The number of teachers whose full participation resulted in LENA certification.
Child Impact: All Children
This section shows average change in turns per hour for all children included in the sample, and how your program's turns change compares to that of all other LENA Grow programs.
See the section on Pre/Post calculations for more detail on how we arrive at these numbers.
Child Impact: Equity
LENA Grow is designed to encourage more equitable talk environments, with the goal that no child should spend the day in language isolation — real or relative. The Child Impact: Equity section of the report measures your program’s impact on "talk equity" by zeroing in on two segments of children:
- Those who entered a LENA Grow classroom experiencing less interaction than their same-room peers.
- Those who entered a LENA Grow classroom experiencing less interaction than the national median.
See the section on inclusion rules for the specific criteria that characterize a child as Bottom Third or Experiencing Low Talk.
Refer to the third page of your Impact Report to find the number of children in each segment.
See the section on Pre/Post calculations for more detail on how we arrive at these numbers.
Teacher-Reported Impact
Taken from the post-sequence survey sent to teachers upon processing the 5th LENA Day, the Teacher-Reported Impact section shows the percent of responding teachers who agreed or strongly agreed with five statements related to target outcomes.
The n is the number of teachers who responded to the question.
At least 5 teacher responses are required in order to present the data. This requirement is necessary to preserve teacher anonymity and to ensure the reported % is meaningful.
A teacher does not need to be certified to complete the survey.
Set Up the Impact Report
You can set up your report to show the date range, sequence type, and specific sites of interest.
By default, the report loads for closed Grow 1 and/or Legacy groups that had their first LENA Day within the previous 365 days, for all sites in your program.
When finished updating the report parameters below, you must click Refresh Report to update the data on the report.
1. Choose which pages to include.
Impact Report pg1 and Impact Report pg2 explain the program and show your data visually.
Impact Report pg3 presents your impact data in table format on a single page, indicates the effect size for each pre/post evaluation, and describes the LENA Benchmarks.
Impact Report Groups and Impact Report Participants are tables detailing exactly which groups and children were and were not included in pre/post evaluations, and the related data for each.
2. Set the date range for LENA Day 1.
Adjust start and end dates to capture data from groups that began in a specific date range.
The report will include groups with LENA Day 1 in this range that also meet the inclusion criteria.
Note that LENA Days 2 and beyond can occur well after the specified end date. (See Group Inclusion Criteria and Evaluation Period.)
3. Select the sequence type.Grow 1 is the 5-week LENA Grow Essentials sequence, introduced in July 2022.
Legacy encompasses all previous versions of LENA Grow.
Grow 2 is the 5-week LENA Grow Insights sequence.
Tip:
If your program has run both Grow 1 and Legacy, but you want to look at only one type, use the date parameters to return data for just one version of the program, or for both versions combined.
4. Select individual sites (optional).
Use the checkboxes to limit the report to one or more specific sites, if desired. Note that the fewer groups and children you're reporting on the less statistically powerful the results will be.
Impact Report Inclusion Rules
LENA applies criteria for minimum number of days, maximum days to consider, and maximum time spans and gaps to help ensure both that the data reflect a LENA Grow “dosage” and experience that reasonably adhere to the program's fidelity requirements (found in Appendix A of the Coach Guide), and that the data are reasonably comparable from group to group and child to child.
These rules account for differences you may see in the By the Numbers section when viewing total number served versus the number of groups and children with "enough data to be included."
Evaluation inclusion rules differ slightly for the current 5-week sequences versus the 10-week Legacy version of LENA Grow, as outlined in the tables below.
Group-Level Inclusion Criteria
To be included in outcomes evaluation, a Group must:
| Grow 1 Essentials OR Grow 2 Insights | Legacy |
|
|
Refer to the third page of your Impact Report to see a breakdown of the number of groups that did and did not meet these inclusion criteria.
Evaluation Period
The evaluation period for any included group, and for the included children and recordings within it, starts with the group's LENA Day 1 and ends when the group reaches either the maximum number of LENA Days to consider OR the maximum period, whichever is earlier.
Child-Level Inclusion Criteria
To be included in the evaluation, a Child must:
| Grow 1 Essentials OR Grow 2 Insights | Legacy |
|
|
Refer to the third page of your Impact Report to see a breakdown of the number of children who did and did not meet these inclusion criteria.
Child Segmentation
Children who meet inclusion criteria are further evaluated for classification into segments representing low levels of interactive talk relative to their peers or to national levels.
Child Segment: Bottom Third
When an included child's average hourly turns count on his or her first LENA Day in an included group ranks in the bottom 34% for children in that group on the same day, the child is included in the Bottom Third evaluation.
Important considerations:
- The Bottom Third classification is specific to each child's first LENA Day experience relative to same-group peers on the same day.
-
- Bottom Third does not mean the child is in the bottom 1/3 of your entire Impact Report sample.
- Bottom Third does not necessarily mean bottom 1/3 on the group's first LENA Day, because a child's first LENA Day in a group may not be the group's first LENA Day.
Child Segment: Experiencing Low Talk
When an included child's average hourly turns count on his or her first LENA Day in an included group is less than 15, the child is included in the Experiencing Low Talk evaluation.
Pre/Post Measurements Defined
For the Pre turns per hour (TPH) value, we:
- Identify the children who meet criteria for the evaluation at hand (all children, Bottom Third, or Experiencing Low Talk).
- Calculate the average TPH for each child's first LENA Day in any included group.
- Exception: For Legacy groups, we also separately calculate TPH for the child's second LENA Day, as long as it is also the group's second LENA Day. Then we average the child's Day 1 and Day 2 values.
- Average the TPH values for all relevant children.
For the Post turns per hour (TPH) value, we:
- Identify the children who meet criteria for the evaluation at hand (All Children, Bottom Third, or Experiencing Low Talk).
- Calculate the average TPH for each child's last LENA Day in any included group. If the child's next-to-last LENA Day within the evaluation period occurred within 2 weeks of the last day, then we also calculate the average TPH for that day, and average the two days.
- Average the TPH values for all relevant children.