📇
Catalogue API
  • Catalogue API
  • developers
  • How users request items
  • Search
    • Current queries
      • images
      • Query structure
    • Search
      • Changelog
      • Collecting data
      • Query design
      • Query design
      • wellcomecollection.org query development index
      • Reporting and metrics
      • Work IDs crib sheet
      • Analysis
        • Less than 3-word searches
        • Subsequent searches
        • Searches with 3 words or more
      • Hypotheses
        • Behaviours
        • Concepts, subject, and another field
        • Concepts, subjects with other field
        • Concepts, subjects
        • Contributor with other field
        • Contributors
        • Further research and design considerations
        • Genre with other field
        • Genres
        • Mood
        • Phrases
        • Reference number with other field
        • Reference numbers
        • Search scenarios
        • Synonymous names and subjects
        • Title with other field
        • Titles
      • Relevance tests
        • Test 1 - Explicit feedback
        • Test 2 - Implicit feedback
        • Test 3 - Adding notes
        • Test 4 - AND or OR
        • Test 5 - Scoring Tiers
        • Test 6 - English tokeniser and Contributors
        • Test 7 - BoolBoosted vs ConstScore
        • Test 8 - BoolBoosted vs PhaserBeam
    • Rank
      • Rank cluster
      • Developing with rank
      • Testing
Powered by GitBook
On this page
  • Candidates
  • Results
  • Conclusions
  1. Search
  2. Search
  3. Relevance tests

Test 3 - Adding notes

PreviousTest 2 - Implicit feedbackNextTest 4 - AND or OR

Last updated 11 months ago

Candidates

Two candidates were compared, one control, and one introducing the newly indexed notes to the list of queried fields. These fields are inconsistently filled out and their lengths can vary wildly, so we'd like to check that their inclusion doesn't dramatically affect the documents' IDF and therefore the overall goodness of search.

without notes

Current default, searching only the title, description, subject, genre, identifiers.

with notes

Notes fields are also queried alongside the default fields, with no extra boosting

Results

As mentioned in , we saw no discernable difference between the two candidates.

Conclusions

The reason we saw no difference is that the test never really ran as a result of a in the query selection. Decided to delay re-testing in favour of changes that we suspect will be more impactful.

#3933
bug