Learner Responsive (LR) Qualification Success Rate (QSR) and Minimum Level of Performance (MLP) FAQ's
FAQ's:
Why do I not have a QSR or a MLP report?
Why do I not have a new QSR or MLP report?
When will reports be published?
I cannot open my zip file
How is data for years before 2008/09 calculated?
How is success rate calculated?
How is achievement rate calculated?
How is retention rate calculated?
What do I do with my csv file?
What is the difference between success rates on QSR and MLP (for 2008/09 data)?
What is a ‘start’?
What qualifications are not included?
Are the qualifications included in MLP the same as in QSR?
Where does ‘glh’ figure come from?
How is weighted success rate calculated?
How is associated funding calculated?
How is provision below threshold calculated?
Colour coding on Page 1
Colour coding on Page for provider summary by SSA (page 2+)
Colour coding for map code level report
What is a map code?
Will my funding be affected/what will be the impact on my funding?
At what level is MLP applied?
How can I find out more about MLP policy and application?
What changes have been made to the Transfer processing?
Final Reports: Matching process
Final Reports: De-Duplication Process
FAQ:
Why do I have a Qualification Success Rate report and no Minimum Level Performance?
Answer:
If providers only have a QSR it is because they only deliver qualifications which are not included in MLP. Those qualifications which are excluded from MLP but reported on in a QSR report are Key Skills, Functional Skills and AS levels.
Back to top
FAQ:
Why do I not have a QSR or a MLP report?
Answer:
Possibly because you have not made a F05 submission this year.
Back to top
FAQ:
Why do I not have a new QSR or MLP report
Answer:
New reports will be produced when a provider resubmits a F05 file in between the dates of publication. If providers do not submit a revised F05 return then a revised report will not be produced.
Back to top
FAQ:
When will reports be published?
Answer:
QSR reports
14 December 2009 (based on data submitted by 4 December 2009)
13 January 2010 (based on data submitted by 4 January 2010)
26 January 2010 (based on final data submitted by 15 January 2010)
MLP reports two days later
16 December 2009 (based on data submitted by 4 December 2009)
15 January 2010 (based on data submitted by 4 January 2010)
28 January 2010 (based on final data submitted by 15 January 2010)
Back to top
FAQ:
I cannot open my zip file
Answer:
Providers who encounter this problem should ask their IT team for advice as they will need to have an appropriate zip tool installed for them to be able to open the file. Data Service can provide link to free software.
Back to top
FAQ:
How is data for years before 2008/09 calculated?
Answer:
The data on the QSR for previous years has been based on the methodology for 2007/08 so will be the same as values on last year’s reports. DLF methodology has not been applied to previous years.
Back to top
FAQ:
How is success rate calculated?
Answer:
In simple terms success rate is the number of aims achieved divided by the number started
Back to top
FAQ:
How is achievement rate calculated?
Answer:
In simple terms achievement rate is the number of aims achieved divided by the number completed.
Back to top
FAQ:
How is retention rate calculated?
Answer :
In simple terms retention rate is the number of aims completed divided by the number started.
Back to top
FAQ:
What do I do with my csv file?
Answer:
For some providers the extract was too large for Excel (Excel 2007 would be OK) so it has been provided as a csv file which can be imported into Excel.
Back to top
FAQ:
What is the difference between success rates on QSR and MLP (for 2008/09 data)?
Answer:
QSR is success rates based on the number who achieved by the number who started but the MLP has a weighted success rate which takes into account the number of guided learning hours.
Back to top
FAQ:
What is a ‘start’?
Answer:
A ‘start’ is a learning aim which is planned to end in the year and the learner: -
· has not transferred within the provider
· is funded by LSC
· Is not under 16 at start of learning
did not withdraw in the first six weeks
Back to top
FAQ:
What qualifications are not included?
Answer:
Key Skills and Functional Skills are excluded from the reports but separate sections in the QSR report on Key Skills (Section 14) and Functional Skills (Section 13).
Other exclusions are documented in the methodology.
Back to top
FAQ:
Are the qualifications included in MLP the same as in QSR?
Answer:
Yes, except for AS levels which are excluded from MLP Reporting
Back to top
FAQ:
Where does ‘glh’ figure come from?
Answer:
Guided learning hours are the total of the guided learning hours for each year of the aim. Uses A_INYR_EXPECTED_GLH derived variable
Back to top
FAQ:
How is weighted success rate calculated?
Answer:
The sum of guided learning hours for aims in scope achieved divided by the sum of guided learning hours for aims in scope multiplied by 100.
For example, (sum A_TOTAL_INYR_EXPECTED_GLH where p_achieved_funded=1) divided by (Sum A_TOTAL_INYR_EXPECTED_GLH) multiplied by 100.
Back to top
FAQ:
How is associated funding calculated?
Answer:
This is derived from A_TOTAL_PAYMENT_Y2D – summed for each year of aim
Back to top
FAQ:
How is provision below threshold calculated?
Answer:
For an individual map code if the SSA cell on the provider summary by SSA is red (that is below the threshold) and the weighted success rate for the map code is below the threshold this will also be red and the glh will be included in the total of provision below threshold
Back to top
FAQ:
Colour coding on Page 1
Answer:
Red if % of provision below threshold is greater than 25%. Yellow if between 15% and 25% is below threshold.
Back to top
FAQ:
Colour coding on Page for provider summary by SSA (page 2+)
Answer:
Red if the weighted success rate for the cell is below the threshold. Green if equal or greater than threshold
Back to top
FAQ:
Colour coding for map code level report
Answer:
Yellow if the weighted success for the map code is below the threshold but the weighted success rate for the SSA and level on the provider summary is not below the threshold
Back to top
FAQ:
What is a map code?
Answer:
Map code is a grouping of aims e.g. A level history which includes the different aims for A level history for each examining board.
Back to top
FAQ:
Will my funding be affected/what will be the impact on my funding?
Answer:
The Data Service cannot comment please contact your local LSC
Back to top
FAQ:
At what level is MLP applied?
Answer:
This is normally at Regional level but for further details see MLP policy
Back to top
FAQ:
How can I find out more about MLP policy and application?
Answer:
Refer to policy document on the LSC website URL: www.lsc.gov.uk/aboutus/quality/intervention
Back to top
FAQ:
What changes have been made to the FE NVQ exclusion processing?
Answer:
If a learning aim was recorded as an FE NVQ aim between 2004 and 2007 (A18 coded as 12,13,15,16,22,23 and A10 = 20) in the final F05 submissions then it was removed from the methodology. However if it was only coded thus in the latest year and not in the earlier year then the older record was being included in the methodology. This has now been fixed.
Back to top
FAQ:
What changes have been made to the Transfer processing?
Answer:
Where a learner has two entries for the same course starting on the same date and finishing in the same Academic year and one of them was a Transfer sometimes the record that would have contributed to success rates was excluded rather than the Transfer. This has now been fixed.
Back to top
FAQ:
Final Reports - 6 Week Rule
Answer:
Long aims greater than 24 weeks where the learner has withdrawn (the record must be flagged as withdrawn i.e. A34 = 3) within 6 weeks and where no funding payment has been made, have been removed from the QSR / MLP results. Note: the previous version of the methodology used a derived variable which was not appropriate if the start and end dates were in different academic years.
Aim length is calculated using Actual Start Date (A27) and Planned End Date (A28)
Length of stay is calculated using Actual Start Date (A27) and Actual End Date (A31).
For short courses the qualifying period is two weeks and for very short courses it is one day.
Back to top
FAQ:
Final Reports: Matching process
Answer:
The matching process matches your final F05 submissions from 2004/05 through to 2008/09. It will try to match using a combination on L01(provider number), L03 (learner number), A09 (aim reference) together with the following combinations in the following sequence:
· A27(start date), A28(planned end date), A31(actual end date)
· A27, A28
· A27, ExpectedEndYr, A31
· A27, ExpectedEndYr
· For aims prior to 2007/08 the following combinations will be used
· StartYear, ExpectedEndYr, A31
· StartYear, ExpectedEndYr
Once matched we will disregard the prior years record and use the latest record.
Back to top
FAQ:
Final Reports: De-Duplication Process
Answer:
In the Interim reports a de-duplication process within the methodology was run in-year and across years to get a single combination of L01, L03, A09, A27, StartYear and Expected End Year. This has now been removed as it is quite legitimate to have multiple generic aims for a learner in year.
Back to top
