Test problems from past UKLO competitions



This page gives you a spreadsheet listing all the test problems that have been used in UK Olympiads since 2010; each problem’s name includes a link to the downloadable problem. The spreadsheet is not locked, so once you’ve saved it locally, you can easily search it, edit it or re-sort the data.  The same problems are also listed below.

Each problem is listed with the following information:

  • diff: its relative difficulty, as explained below
  • year: the year in which it was used in UKLO
  • number, name: its number in that year’s problem set, and its name
    • this cell is hyperlinked to a file containing the problem concerned, a separate answer sheet (where relevant), and the correct answers, plus a mark scheme and detailed directions for marking (as used by the original markers).
  • language: the language(s) from which its data are taken
  • extras?: any information beyond the problem and its solution.
    • expanded: an extended essay-length discussion of the problem and how to solve it, as well as ideas for building on it in discussing more general ideas about language and linguistic analysis.
    • notes: brief notes on the problem data, possibly as a separate file from the problem file.
    • problem, solution, commentary and marking scheme: a single file containing all relevant information.

Relative difficulty

The problems are also classified for difficulty. Here’s how this was calculated:

  • For problems from 2012 and later, the grading is objective and reflects the average marks of hundreds of competitors. Informally, the difficulty is the difference between the maximum possible mark and the average mark; so if everyone scores 100%, the difficulty is 1, but if the average is just 10%, the difficulty is 10. But as you’ll see below, it has to be more complicated than that!
    • Mathematically, the difficulty (diff) of a problem is the maximum score for that problem divided by the average score;
      • e.g. if the maximum was 20 and the average was 10, diff would be 2.0.
      • If everyone achieved the maximum, diff would be 1.0.
      • If the average was very low, say 1/20, diff would be 20.
    • However, difficulty depends not only on the problem but also on the competitor, so a problem which would be very hard for a Foundation competitor might be quite easy for an Advanced one. The figure for diff is therefore standardised for a typical Advanced competitor:
      • Where a problem was part of the Advanced competition in Round 1, diff is calculated as above.
      • Problems which were only included at lower levels (Breakthrough, Foundation or Intermediate) had their diff reduced by a figure based on the problems which were taken both at these levels and at higher levels, including Advance levels.
        • E.g. if an I-level problem’s average score was 5/10, giving an I-level diff of 10/5 = 2,
        • and the same competitors scored half (0.5) as well as the Advanced competitors did on the problems that they both did, giving an ‘I-adjustment’ for I and A (the mean I and A scores for those problems) of I/A = 0.5
        • then its diff (for a typical A-level candidate) was 2 x 0.5 = 1.
        • Similarly for lower levels: so the diff of a Breakthrough problem is given by B x F x I where
          • B = the diff for Breakthrough candidates
          • F is the F-adjustment figure (F/I) for problems taken at both F and I level
          • I is the I-adjustment figure (I/A) for problems taken at both I and A level.
        • This standardization calculation explains why some diff figures are below 1.0 (which would otherwise be the lowest possible).
      • Problems from Round 2 had their diff increased by a figure based on the difference between the Round 1 figures for the winners (who eventually took Round 2) and the overall average.
        • E.g. if the R2 diff for a problem was 2,
        • and the R1 Advanced winners’ average score was twice the average for all Advanced competitors,
        • then its diff for a typical A-level candidate was 2 x 2 = 4.
  • For problems from 2010 and 2011, unfortunately we have no data on scores for individual problems, so diff is copied from the grading in the two books of problems. This five-point grading is partly based on test scores in the American competition and partly estimated by test-setters; unfortunately there are no problems graded by both systems, so they are hard to match. For that reason, the American gradings are distinguished from the others by *.
  • The diff rating for the 2011 problem 2, ‘Japaneasy’, is a guess because it is not covered by either of the above systems. It’s highly recommended as a starting point for exploring the problems!

The problems

diff year number, name language extras? area author
0.5 2011 2. Japaneasy Japanese expanded script Harold Somers
0.54 2014 3. Mokilese Mokilese expanded general Jeff Siegel
0.67 2014 1. What time is it in Tallinn? Estonian expanded general Babette Newsome
0.9 2016 2. Foreign French, German, Spanish problem, solution, commentary and marking scheme comparative Dick Hudson
0.89 2012 1. Being with it in Yolmo Yolmo expanded general Lauren Gawne
0.9 2017 R1.3. We are all European 9 languages notes and solution comparative Babette Newsome
0.92 2012 2. Danish numbers Danish expanded general Mike Swan
0.9 2016 4. Beijing subway Chinese problem, solution, commentary and marking scheme script Catherine Sheard
1.0 2016 1. Alphabet Greek problem, solution, commentary and marking scheme script Dick Hudson
1.05 2017 R1.1. Our Italian family Italian notes and solution morphosyntax Dick Hudson
1.06 2015 1. Counting in Karelian Karelian   general Graeme Trousdale
1.08 2014 2. Maori loanwords Maori notes general Pat Littell
1.17 2012 6. Crocodile Bardi Bardi   general Catherine Sheard
1.18 2017 R1.5. Basquing in the sun Basque notes and solution morphosyntax Aleka Blackwell 
1.2 2013 8. A little Dutch problem Dutch   general Harold Somers
1.3 2016 9. Nhanda Nhanda problem, solution, commentary and marking scheme general Babette Verhoeven
1.26 2014 6. Kairak verbs Kairak notes general Cindy Schneider
1.26 2015 2. Georgian places Georgian   script Daniel Rucki
1.3 2016 8. Somali Somali problem, solution, commentary and marking scheme morphology Harold Somers
1.32 2015 3. Polish your Polish Polish   general Daniel Rucki
1.36 2012 3w. Welsh libraries Welsh notes general Dick Hudson
1.4 2016 6. Kaqchikel Kaqchikel problem, solution, commentary and marking scheme general Michael Yoshitaka Erlewine
1.38 2014 4. Running speech English notes phonetics, script Sue Barry & Dick Hudson
1.39 2017 R1.4. A little Tshiluba Tshiluba notes and solution morphosyntax Tom McCoy
1.4 2016 3. Watsonium Irish problem, solution, commentary and marking scheme spelling of loans Jane D’Altuin and Harold Somers
1.42 2017 R1.2. Inuktitut script Inuktitut notes and solution script Ollie Sayeed
1.4 2016 5. Amele Amele problem, solution, commentary and marking scheme general Babette Verhoeven
1.44 2013 5. Bulgarian Bulgarian   syntax Bozhidar Bozhanov
1.5 2016 R2.1 Malay Malay Problem, solution and marking general Bozhidar Bozhanov
1.51 2015 4. Old English English   general Graeme Trousdale
1.6 2016 7. The strange case of the Estonian language Estonian problem, solution, commentary and marking scheme general Praveen Venkataramana
1.56 2013 1. Yodaspeak English   syntax Harold Somers
1.59 2012 8. Arcturan intergalactic peace message fictitious language   general Simon Zwarts
1.59 2015 5. Elder Futhark Norse   script Catherine Sheard
1.69 2012 7. Waorani numbers Waorani   general Drago Radev
1.72 2012 R2.2. Who is good? Luiseño   general Ronald Langacker (via Dick Hudson)
1.76 2012 4. Haitian Haitian  notes general Ivaylo Youmerski
1.76 2015 8. Can you finish Finnish? Finnish   general Babette Newsome
1.77 2017 R1.6. Maori for the beach Maori notes and solution grammar Aleka Blackwell 
1.77 2017 R1.8. Choctaw Choctaw notes and solution morphosyntax Babette Newsome
1.79 2013 6. The long and short of English verbs English notes general Dick Hudson
1.8 2016 R2.2. Tocharian Tocharian Problem, solution and marking historical Ollie Sayeed
1.93 2012 5. Esperanto Esperanto   general Alexey Pegushev
2.1 2016 R2.5. Get edumacated! English Problem, solution and marking phonology Patrick Littell
2.12 2013 3. Pali Pali   general Babette Newsome
2.13 2015 7. Murrinhpatha Murrinhpatha   general Rachel Nordlinger
2.2 2016 10. Don’t sell the house! Nung problem, solution, commentary and marking scheme general Alex Wade
2.22 2012 R2.1. A fox among the h English   computing Patrick Littell
2.35 2012 R2.3. The little engine that could… read English   logic James Pustejovsky, Patrick Littell
2.4 2012 9. Waanyi Waanyi   general Mary Laughren
2.46 2015 R2.3 Do-this-do-that Hmong  notes general David Mortensen
2.56 2015 9. Zoink! English   semantics Dragomir Radev with Christiane Fellbaum and Jonathan May
2.65 2017 R1.9. The goat, the mother and the Abkhaz wardrobe Abkhaz notes and solution grammar Samuel Andersson, Oliver Sayeed, and Elysia Warner
2.74 2015 6. Japanese places Japanese   general Harold Somers
2.8 2016 R2.4. Devanagari Devanagari Problem, solution and marking script Lauren Gawne
2.8 2016 R2.3. Huli Huli Problem, solution and marking numbers Bill Huang
2.84 2017 R2.1. Nepali Nepali notes and solution grammar Babette Newsome
2.88 2017 R2.3. Viet Vietnamese notes and solution grammar James Hyett
2.99 2014 5. Turkish Turkish notes general David Palfreyman
3.06 2012 R2.5. Catalan plurals Catalan   general Boris Iomdin
3.2 2017 R1.10. Kaytetye kinship Kaytetye notes and solution semantics Myfany Turpin
3.24 2014 7. Ilokano Ilokano notes general Bozhidar Bozhanov
3.29 2013 9. Bengali Bengali notes general Bozhidar Bozhanov
3.32 2017 R2.2. Do you see what I see? Proto-Algonquian  notes and solution morphosyntax Daniel Lovsted
3.39 2012 3d. Dutch past participles  Dutch notes general Babette Newsome
3.49 2013 4a. Arabic script Arabic notes script David Palfreyman
3.63 2015 R2.2 Malagasy crossnumber Malagasy  notes numbers Tom McCoy
3.98 2014 9. Lontara Buginese notes script Chelsea Voss
4.02 2017 R2.4. Muddled hieroglyphs Egyptian notes and solution script Dick Hudson
4.23 2017 R1.7. On the right Tamil track Tamil notes and solution script Kai Low 
4.35 2017 R2.5. Magic Yup’ik Yup’ik notes and solution number Kai Low 
4.61 2014 R2.1. Kiswahili verbs Kiswahili   general Catherine
5.63 2013 R2.4. Stockholms Tunnelbana Swedish   general Patrick Littell
5.74 2013 R2.1. Deer Father Quechua   general Patrick Littell
6.06 2013 4s. The Shavian Alphabet English – Shavian notes script Babette Newsome
6.48 2014 R2.2. Untangling Tanghulic  Kachai, Tusom, Ukhrul   comparison David Mortensen
6.5 2015 R2.4 Aymara Aymara   phonology Josh Falk
6.68 2014 R2.4. Navajo gophers Navajo   general Babette Newsome
8.11 2014 R2.3. Learning Yidiny Yidiny   general Mary Laughren
8.58 2015 5 Romance Latin, French, Catalan, Romanian   historical comparison David Palfreyman
8.72 2013 7. Phoenician Phoenician   script Harold Somers
9.01 2014 R2.5. Hungarians in a field Hungarian   puzzle Adam Hesterberg
9.43 2015 R2.1 Maxakali Maxakali   general Alex Wade
9.48 2015 10. Georgian Era Georgian   script, general Dorottya Demszky
9.99 2013 R2.5. Playing the cognate game Indonesian, Swahili   etymology Catherine Sheard
12.7 2013 R2.3. Beja Beja   general Dick Hudson
17 2014 8. Musical code English notes code Harold Somers
32.9 2013 R2.2. Putting the books in order  Georgian, Armenian   script Drago Radev
33.3 2012 R2.4. 100 surnames Phags-pa   script Patrick Littell
*1 2010 1. Sorry we have no red cucumbers French   syntax Dragomir Radev
*1 2010 2. Gelda’s House of Gelbergarg English   general Cindy Schneider
*1 2010 3. Say it in Abma Abma   general Luda Kedova & Rachel Nordlinger
*1 2010 R2.3. F u cn rd ths English   computing Richard Sproat
*2 2010 R2.1. Ardhay Uzzlepay Minangkabau   general Diego Molla-Aliod
*2 2011 7. The war of the dots English (braille)   script Patrick Littell
*2 2011 R2.1. Stopping and flapping in Warlpiri Warlpiri   general Mary Laughren
*2 2011 R2.2. Counting in Irish Irish notes general Tom Payne
*2 2011 1. Running on MT English   meaning Harold Somers
*2 2011 3. Doubling in Caterpillar Country Arrernte notes general Mark Dras & Mary Laughren
*2 2011 5. Mix up on the farm Papago   general Lori Levin (data from Ken Hale)
*2 2011 6. Tiger tale Indonesian   general Dragomir Radev
*3 2010 4. Lost in Yerevan Armenian   script Dragomir Radev
*3 2010 7. Texting, texting, one two three English   code Patrick Littell
*3 2010 R2.2. Be Cree-ative Cree   script Patrick Littell & Julia Workman
*3 2010 6. Tangkhul tangle Tangkhul   general David Mortensen
*3 2010 R2.4. Tale of Kieu Vietnamese   script David Mortensen
*3 2010 R2.5. Possessed in Vanuatu Vanuatu   general Jane Simpson & Jeremy Hammond
*3 2011 4. Ulwa possessives Ulwa notes general Richard Sproat
*4 2011 R2.5. Swallow the salt Tadaksahak   general Bozhidar Bozhanov
*5 2010 5. Turkish delight Turkish   general Bozhidar Bozhanov
*5 2011 R2.3. Axolotl in the water Nahuatl   general John Berman
*5 2011 R2.3. A script for the Ndyuka Ndyuka   script Patrick Littell

One Response to Past Questions

  1. Many of us remain involved with our looks while looking for most
    occasions or event. These designers usually are personal favorites and not force fed towards the masses,
    a minimum of not yet. If you are interested in the
    same ease and comfort with regards to setting hair, and then make
    sure you obtain your hands on this dryer without the further delay.

Set your Twitter account name in your settings to use the TwitterBar Section.