FAQ's Learner Responsive QSR / MLP Reports
FAQ: I cannot open my zip file
Answer: Providers who encounter this problem should ask their IT team for advice as they will need to have an appropriate zip tool installed for them to be able to open the file. The Data Service can provide a link to free software: http://www.winzip.com/trialpay.htm
FAQ: Why do I have a Qualification Success Rate report and no Minimum Level Performance?
Answer: If providers only have a QSR it is because they only deliver qualifications which are not included in MLP. Those qualifications which are excluded from MLP but reported on in a QSR report are Key Skills, Functional Skills and AS levels.
FAQ: How is data for years before 2008/09 calculated?
Answer: The data on the QSR for previous years has been based on the methodology for 2007/08 so will be the same as values on last year’s reports. DLF methodology has not been applied to previous years.
FAQ: How do I reconcile my MI system against the QSR data?
Answer: The CSV file contained within your QSR zip file details all records used in the production of your 2008/09 success rates. The guidance note included within the zip details how to query this file.
FAQ: What is the difference between QSR Report and the MLP Report?
Answer: For 2008/09 the QSR is based on the number who achieved by the number who started whereas the MLP is the has a weighted success rate (see FAQ How is weighted success rate calculated?) which takes into account the number of guided learning hours.
FAQ:What is a ‘start’?
Answer:
A ‘start’ is a learning aim which is planned to end in the academic year and the learner: -
· has not transferred within the provider
· is not under 16 at start of learning
· did not withdraw in the first six weeks
FAQ:What qualifications are not included?
Answer: Key Skills and Functional Skills are excluded from the reports but separate sections in the QSR report on Key Skills (Section 14) and Functional Skills (Section 13).
Other exclusions are documented in the methodology.
FAQ: Are the qualifications included in MLP the same as in QSR?
Answer: Yes, except for AS levels which are excluded from MLP Reporting
FAQ: Where does ‘glh’ figure come from?
Answer: Guided learning hours are the total of the guided learning hours for each year of the aim. Uses A_INYR_EXPECTED_GLH derived variable
FAQ: How is weighted success rate calculated?
Answer:
The sum of guided learning hours for aims in scope achieved divided by the sum of guided learning hours for aims in scope multiplied by 100.
For example, (sum A_TOTAL_INYR_EXPECTED_GLH where p_achieved_funded=1) divided by (Sum A_TOTAL_INYR_EXPECTED_GLH) multiplied by 100.
FAQ: How is associated funding calculated?
Answer:
This is derived from A_TOTAL_PAYMENT_Y2D – summed from each year in which the aim was submitted.
FAQ: How is provision below threshold calculated?
Answer:
For an individual map code if the SSA cell on the provider summary by SSA is red (that is below the threshold) and the weighted success rate for the map code is below the threshold this will also be red and the glh will be included in the total of provision below threshold
FAQ: Colour coding on Page 1
Answer: Red if % of provision below threshold is greater than 25%. Yellow if between 15% and 25% is below threshold.
FAQ: Colour coding on Page for provider summary by SSA (page 2+)
Answer: Red if the weighted success rate for the cell is below the threshold. Green if equal or greater than threshold
FAQ: Colour coding for map code level report
Answer: Yellow if the weighted success for the map code is below the threshold but the weighted success rate for the SSA and level on the provider summary is not below the threshold
FAQ: What is a map code?
Answer: Map code is a grouping of aims e.g. A level history which includes the different aims for A level history for each examining board.
FAQ: What changes have been made to the Transfer processing?
Answer: Where a learner has two entries for the same course starting on the same date and finishing in the same Academic year and one of them was a Transfer sometimes the record that would have contributed to success rates was excluded rather than the Transfer. This has now been fixed.
FAQ: Final Reports - 6 Week Rule
Answer: Long aims greater than 24 weeks where the learner has withdrawn (the record must be flagged as withdrawn i.e. A34 = 3) within 6 weeks and where no funding payment has been made, have been removed from the QSR / MLP results. Note: the previous version of the methodology used a derived variable which was not appropriate if the start and end dates were in different academic years.
Aim length is calculated using Actual Start Date (A27) and Planned End Date (A28)
Length of stay is calculated using Actual Start Date (A27) and Actual End Date (A31).
For short courses the qualifying period is two weeks and for very short courses it is one day.
FAQ: Final Reports: Matching process
Answer: The matching process matches your final F05 submissions from 2004/05 through to 2008/09. It will try to match using a combination on L01(provider number), L03 (learner number), A09 (aim reference) together with the following combinations in the following sequence:
· A27(start date), A28(planned end date), A31(actual end date)
· A27, A28
· A27, ExpectedEndYr, A31
· A27, ExpectedEndYr
· For aims prior to 2007/08 the following combinations will be used
· StartYear, ExpectedEndYr, A31
· StartYear, ExpectedEndYr
Once matched we will disregard the prior years record and use the latest record.
FAQ: Final Reports: De-Duplication Process
Answer: In the Interim reports a de-duplication process within the methodology was run in-year and across years to get a single combination of L01, L03, A09, A27, StartYear and Expected End Year. This has now been removed as it is quite legitimate to have multiple generic aims for a learner in year.
FAQ: I seem to have duplicate records in my data?
Answer: The success rate methodology matches across year by matching on L01, L03, A09, A27, and the expected end year,
if you amended any of these details across years then this can result in multiple records which will be counted.
Please refer to the Data Extract supplied with your QSR report for record details.
FAQ: When is the 2009/10 Methodology available
Answer: It is expected that this will be published around July 2010.
FAQ: NVQ’s moved into ER are still showing in my Success Rates?
Answer: NVQs coded in 2006/2007 and 2007/08 with a main delivery method of 12,13,15,16,22,23 where the learner was aged 19+ were considered for DLF modelling purposes to be “delivered in
the workplace” and therefore funded via employer responsive provision under demand led funding. The success rate calculation, uses the same methodology, and includes these learners in the Train to gain success rates as this is how adult provision delivered in the workplace
is funded from 2008/09 onwards. In addition due to the ambiguity of the ILR specification those
classed 15 or 16 will only be included within the TTG methodology if they have an end date or
have been returned in the 08/09 ER return. Those code as A18 = 14 will continue to be funded by Learner Responsive and will included within the LR success rates.
FAQ: How is the success rate calculated?
Answer: In simple terms success rate is the number of aims achieved divided by the number started
FAQ: How is the achievement rate calculated?
Answer: In simple terms achievement rate is the number of aims achieved divided by the number completed
FAQ: How is the retention rate calculated?
Answer: In simple terms retention rate is the number of aims completed divided by the number started
