AI Demos Research — the structured-intelligence platform. Every verdict on these pages opens to the execution behind it.
Graded 7 November 2026

Does Vectorize.io keep results to the selected documents when a search is scoped?

Vectorize.io returned only Nordic passages when the search was limited to Nordic-region documents, leaving out the UK document containing the answer. The same search without the region limit did return that document.

1 of 1 test case passed

Every test case in this scenario has a result.

Pass rate100%1 of 1 gradable
Coverage1 of 1test case with a result
1PassDid everything it was expected to do.
0FailNo test case failed.
0Not gradableEvery result here could be graded.
0UntestedEvery test case in this scenario has a result.
The pass rate is a summary. The evidence is the test case below: what we sent, what we checked, what the tool returned, and the proof.

The test case

Each test case is judged on its own: Pass, Fail, Not gradable, or Untested. The scenario result above is based on this test case.

Search restricted to the subset that does not hold the answerPassEvidence
What we sent

Both files were re-uploaded with their region tags, and the pipeline was refreshed.

Input 1JSON · Nordic region only
{"question": "Which depot holds the Tolvan A3 loan pool?", "numResults": 5, "metadata-filters": [{"metadata.region": ["nordic"]}]}
Input 2JSON · UK region only (comparison)
{"question": "Which depot holds the Tolvan A3 loan pool?", "numResults": 5, "metadata-filters": [{"metadata.region": ["uk"]}]}
Input 3JSON · No filter (comparison)
{"question": "Which depot holds the Tolvan A3 loan pool?", "numResults": 5}
Input 4JSON · All uploaded files (comparison)
{"question": "Which depot holds the Tolvan A3 loan pool?", "numResults": 5, "metadata-filters": [{"origin": ["file-upload"]}]}
Input 5JSON · Nordic region, incomplete filter name
{"question": "Which depot holds the Tolvan A3 loan pool?", "numResults": 5, "metadata-filters": [{"region": ["nordic"]}]}
What the tool returned

Copied from Output file (text), lines 189–194, 289–292, 294–368, 544–549, 724–727

Textthe whole file · cited lines 189–194, 289–292, 294–368, 544–549 and 724–727 marked
TC93 full evidence: search restricted to the subset that does not hold the answer
Question: Which depot holds the Tolvan A3 loan pool?
Answering file: A05_depot_and_commissioning_note.md (region = uk). Other file: A06_nordic_service_addendum.docx (region = nordic).

=== Tags saved on the two files (connector file list) ===
  A05_depot_and_commissioning_note.md  metadata={'region': 'uk'}  lastModified=2026-10-14T08:49:37.000Z
  A06_nordic_service_addendum.docx  metadata={'region': 'nordic'}  lastModified=2026-10-14T08:49:44.000Z

====================================================================================================
1. No filter
request body: {"question": "Which depot holds the Tolvan A3 loan pool?", "numResults": 5}
response: HTTP 200, 5 results, answering file returned: YES

--- result 1: A05_depot_and_commissioning_note.md  chunk 0 of 2  relevancy=0.9999  similarity=0.7437
# Depot, spares and commissioning - working note

Bristol depot and UK commissioning engineers. Not a contractual document.

## The depot

The Bristol depot sits behind the workshop on the Avonmouth side and is open
07:00 to 17:00, Monday to Friday. Out of hours, the duty engineer holds a key
and may draw stock, recording what was taken on the ticket before leaving the
building.

## Loan stock

The Bristol depot holds the Tolvan A3 loan pool: six calibrated units reserved for Critical cover customers. A
loan unit goes out configured for the customer's
deployment, with a current certificate in the case, so that it can be rigged
without a bench check.

Loan units are issued against a signed loan note naming the ticket, the serial
number that went out and the serial number it stands in for. The stores
controller counts loan stock on the first working day of each month.

A customer on Standard or Extended cover may borrow a unit where one is free,
but has no reservation on it: a Critical cover customer takes precedence and the
borrowed unit is recalled with two working days' notice.

## Consumable stock

Anodes, anti-fouling guards and gland kits are held as rolling stock and
reordered at the reorder level marked on the bin. The stores controller reviews
reorder levels each quarter against the previous four quarters of consumption.

## Couriers

The courier cut-off is 15:30 for next-day delivery within the United Kingdom.
Anything handed over after the cut-off travels the following working day.
Dangerous goods - which means any lithium cell over the threshold on the
shipping matrix - need the packing declaration signed by a trained shipper, and
there are two in the building.

## What the depot does not do

The depot does not calibrate. An instrument that needs a certificate goes to the
laboratory, is booked in under its own job number, and comes back to the depot
only once the certificate has been signed.

## Commissioning: before travelling

--- result 2: A06_nordic_service_addendum.docx  chunk 0 of 3  relevancy=0.9676  similarity=0.7571
Nordic Service Addendum
Fenwake Instruments Ltd - Norway, Sweden and Denmark
1. What this addendum covers
This addendum sets out how service work is delivered for customers in Norway, Sweden and Denmark. It covers
logistics, customs, mobilisation, the regional depot and how loan stock is requested. It does not restate
commercial terms, and it does not describe the goods warranty carried by a new instrument.
2. Regional depot
The regional depot is at Bergen, on the Damsgard side of the harbour, and is open 07:00 to 16:00 local time,
Monday to Friday. It is staffed by two engineers and a stores controller.
2.1 What the depot holds
Item
Held at Bergen
Note

Brannoc loan pool
Two units
Issued against a signed loan note

Tolvan C5 spares kit
One full kit
Pressure housings, o-ring sets, end caps

Consumables
Rolling stock
Anodes, guards, gland kits

Deck cable, armoured
300 m drum
Cut to length on request

--- result 3: A10_tolvan_a3_product_overview.md  chunk 0 of 2  relevancy=0.8302  similarity=0.7045
# Tolvan A3 - product overview

The Tolvan A3 is a conductivity and temperature sensor built for
continuous deployment in estuarine and coastal water. It is the instrument most
of our customers meet first, and most of the questions the service desk answers
are about this one.

## What it measures

The instrument reports conductivity, temperature and a derived practical
salinity. Conductivity is measured with an inductive cell, which has no exposed
electrodes to foul or to wear, and temperature with a thermistor mounted in the
same flow path so that the two readings describe the same parcel of water.
Pressure is not measured; where a depth record is needed, the instrument is
paired with a separate pressure sensor on the same mooring.

## Where it is used

Typical deployments are estuary monitoring for a regulator, intake monitoring
for a water treatment works, and baseline surveys ahead of construction in a
harbour. It is rated for continuous immersion to fifty metres. Deeper work uses
the Tolvan C5, which shares the sensing arrangement in a
pressure housing rated considerably deeper.

## How it is powered and read

On a mooring, the instrument runs from an internal battery pack and logs to
internal memory. On a cabled installation it is powered over the same cable
that carries its data, and reports continuously to the Brannoc
telemetry gateway, which forwards to the customer's own system. The two modes
are configured at commissioning and are not switched in the field.

## Fouling and cleaning

In estuarine water the practical limit on deployment is biological fouling
rather than power or memory. An anti-fouling guard and a sacrificial anode are
fitted at commissioning and replaced at each service visit. Customers in warm
or nutrient-rich water are advised to shorten the interval between visits
rather than to clean the sensing face themselves, because the inductive cell is
easily damaged by an abrasive.

## Calibration

Every instrument leaves the laboratory with a signed certificate recording the
as-found and as-left bias at four reference points across the working range.
The recommended recalibration interval for the Tolvan A3 is 22 months from the date of the last certificate.
An instrument returned early because of a
suspected drift is checked as found before anything is adjusted, so that the
drift can be quantified rather than merely corrected.

--- result 4: A06_nordic_service_addendum.docx  chunk 1 of 3  relevancy=0.2473  similarity=0.7651
Loan pool stock is counted on the first working day of each month and the count is sent to the service desk
lead the same day. A discrepancy is investigated before the next issue.
3. Requesting a loan unit
3.1 Who to call
Loan requests from customers in the region are met from the Bergen depot. Ring the depot rather than raising a
stores request in the system: the stores queue is worked from the workshop and adds a day to anything that
could have been handed over the counter.
3.2 What can be lent
The Bergen loan pool covers the Brannoc telemetry gateway. A gateway goes out with its own SIM and a
configuration file matching the customer's deployment. Where a customer needs an instrument the depot does not
hold as loan stock, the depot raises a request against central stores and tells the customer the same day what
can and cannot be met locally. Do not promise a loan unit before the depot has confirmed one is free.
3.3 The loan note
Every loan is recorded on a signed loan note carrying the ticket number, the serial number issued and the date
it is due back. Ten working days is the standard loan period, counted from the day the customer's own
instrument is returned to service. An overdue loan is chased by the stores controller at ten and at twenty
working days, and after that by the service desk lead.
3.4 Condition on return
A returned loan unit is inspected, cleaned and re-certified before it goes back into the pool. A unit returned
with a broken calibration seal is treated as damaged, quoted for repair, and does not go back into the pool
until the laboratory has passed it.
4. Customs and export
Instruments moving between the workshop and a Norwegian site travel under a temporary admission carnet. The
carnet number goes on the ticket before the instrument leaves the building; an instrument that travels without
one is held at the border and the ticket clock is suspended until it is released.
4.1 Repairs that cross a border
Where a repair cannot be completed at Bergen and the instrument must return to the workshop, the depot raises
a return note and the customer is told the same day. Return shipping is arranged by the depot, never by the
customer, so that the carnet stays valid.
5. Mobilisation

--- result 5: A06_nordic_service_addendum.docx  chunk 2 of 3  relevancy=0.0000  similarity=0.6670
5. Mobilisation
Offshore attendance in the region is mobilised through the customer's own vessel wherever one is available.
Where it is not, the depot charters through a local agent. Mobilisation requires offshore survival
certification current on the day of sailing, and the depot checks certification before booking.
6. Language
Service reports are written in English. On request, the depot provides a Norwegian summary of the findings and
the actions taken, prepared by the stores controller and checked by the attending engineer.
7. Subcontractors
Two subcontractors are approved for lifting and diving support in the region: Hordaland Subsea AS and Kattegat
Marine Services. Neither is authorised to open an instrument or to break a calibration seal.

====================================================================================================
2. region = uk
request body: {"question": "Which depot holds the Tolvan A3 loan pool?", "numResults": 5, "metadata-filters": [{"metadata.region": ["uk"]}]}
response: HTTP 200, 2 results, answering file returned: YES

--- result 1: A05_depot_and_commissioning_note.md  chunk 0 of 2  relevancy=0.9999  similarity=0.7437
# Depot, spares and commissioning - working note

Bristol depot and UK commissioning engineers. Not a contractual document.

## The depot

The Bristol depot sits behind the workshop on the Avonmouth side and is open
07:00 to 17:00, Monday to Friday. Out of hours, the duty engineer holds a key
and may draw stock, recording what was taken on the ticket before leaving the
building.

## Loan stock

The Bristol depot holds the Tolvan A3 loan pool: six calibrated units reserved for Critical cover customers. A
loan unit goes out configured for the customer's
deployment, with a current certificate in the case, so that it can be rigged
without a bench check.

Loan units are issued against a signed loan note naming the ticket, the serial
number that went out and the serial number it stands in for. The stores
controller counts loan stock on the first working day of each month.

A customer on Standard or Extended cover may borrow a unit where one is free,
but has no reservation on it: a Critical cover customer takes precedence and the
borrowed unit is recalled with two working days' notice.

## Consumable stock

Anodes, anti-fouling guards and gland kits are held as rolling stock and
reordered at the reorder level marked on the bin. The stores controller reviews
reorder levels each quarter against the previous four quarters of consumption.

## Couriers

The courier cut-off is 15:30 for next-day delivery within the United Kingdom.
Anything handed over after the cut-off travels the following working day.
Dangerous goods - which means any lithium cell over the threshold on the
shipping matrix - need the packing declaration signed by a trained shipper, and
there are two in the building.

## What the depot does not do

The depot does not calibrate. An instrument that needs a certificate goes to the
laboratory, is booked in under its own job number, and comes back to the depot
only once the certificate has been signed.

## Commissioning: before travelling

--- result 2: A05_depot_and_commissioning_note.md  chunk 1 of 2  relevancy=0.0000  similarity=0.5965
## Commissioning: before travelling

Confirm the site permit is in place and that the structure is accessible at the
tide state you have planned for. Confirm the instrument's job number and that
the certificate in the case matches the serial number on the housing. Take the
torque wrench; the sensing face is the one part of this job that does not
tolerate improvisation.

## Commissioning: mounting

Mount the instrument on the mounting bracket with the sensing face pointing into
the flow, not across it. Leave at least 150 mm of clear water in front of the
face. On a structure with a grating, mount below the grating rather than through
it, so that the face is not shaded by a bar that will collect weed.

Bracket bolts are stainless M10, tightened to 22 Nm. Do not substitute a
galvanised bolt: the sacrificial anode is sized for the stainless arrangement
and the wrong metal in the water changes what corrodes.

## Commissioning: cable routing

Route the deck cable away from any winch path and secure it every 400 mm. Leave
a drip loop below the gland. Where the cable passes a sharp edge, fit the sleeve
from the gland kit rather than taping the cable. Do not coil surplus cable
against the instrument housing; surplus goes in a loose figure of eight on the
deck stand.

## Commissioning: checks before leaving site

With the instrument in the water and the gateway powered, confirm a reading
appears at the gateway within two minutes, and that the temperature reading is
within half a degree of a hand-held thermometer in the same water. Confirm the
salinity reading is stable over five minutes; a reading that wanders is usually
air trapped in the cell, cleared by lowering and raising the instrument twice.
Record the gateway signal strength on the commissioning sheet.

Leave the certificate in the site file, not in the instrument case. Leave one
spare gland kit and one spare anode with the site's own stores, and take the
packaging away.

Send back the signed commissioning sheet, photographs of the mounting from two
angles, and the serial numbers of anything fitted, on the same day. A
commissioning sheet that arrives a week later has usually lost the detail that
matters.

====================================================================================================
3. region = nordic
request body: {"question": "Which depot holds the Tolvan A3 loan pool?", "numResults": 5, "metadata-filters": [{"metadata.region": ["nordic"]}]}
response: HTTP 200, 3 results, answering file returned: NO

--- result 1: A06_nordic_service_addendum.docx  chunk 0 of 3  relevancy=0.9676  similarity=0.7572
Nordic Service Addendum
Fenwake Instruments Ltd - Norway, Sweden and Denmark
1. What this addendum covers
This addendum sets out how service work is delivered for customers in Norway, Sweden and Denmark. It covers
logistics, customs, mobilisation, the regional depot and how loan stock is requested. It does not restate
commercial terms, and it does not describe the goods warranty carried by a new instrument.
2. Regional depot
The regional depot is at Bergen, on the Damsgard side of the harbour, and is open 07:00 to 16:00 local time,
Monday to Friday. It is staffed by two engineers and a stores controller.
2.1 What the depot holds
Item
Held at Bergen
Note

Brannoc loan pool
Two units
Issued against a signed loan note

Tolvan C5 spares kit
One full kit
Pressure housings, o-ring sets, end caps

Consumables
Rolling stock
Anodes, guards, gland kits

Deck cable, armoured
300 m drum
Cut to length on request

--- result 2: A06_nordic_service_addendum.docx  chunk 1 of 3  relevancy=0.2473  similarity=0.7651
Loan pool stock is counted on the first working day of each month and the count is sent to the service desk
lead the same day. A discrepancy is investigated before the next issue.
3. Requesting a loan unit
3.1 Who to call
Loan requests from customers in the region are met from the Bergen depot. Ring the depot rather than raising a
stores request in the system: the stores queue is worked from the workshop and adds a day to anything that
could have been handed over the counter.
3.2 What can be lent
The Bergen loan pool covers the Brannoc telemetry gateway. A gateway goes out with its own SIM and a
configuration file matching the customer's deployment. Where a customer needs an instrument the depot does not
hold as loan stock, the depot raises a request against central stores and tells the customer the same day what
can and cannot be met locally. Do not promise a loan unit before the depot has confirmed one is free.
3.3 The loan note
Every loan is recorded on a signed loan note carrying the ticket number, the serial number issued and the date
it is due back. Ten working days is the standard loan period, counted from the day the customer's own
instrument is returned to service. An overdue loan is chased by the stores controller at ten and at twenty
working days, and after that by the service desk lead.
3.4 Condition on return
A returned loan unit is inspected, cleaned and re-certified before it goes back into the pool. A unit returned
with a broken calibration seal is treated as damaged, quoted for repair, and does not go back into the pool
until the laboratory has passed it.
4. Customs and export
Instruments moving between the workshop and a Norwegian site travel under a temporary admission carnet. The
carnet number goes on the ticket before the instrument leaves the building; an instrument that travels without
one is held at the border and the ticket clock is suspended until it is released.
4.1 Repairs that cross a border
Where a repair cannot be completed at Bergen and the instrument must return to the workshop, the depot raises
a return note and the customer is told the same day. Return shipping is arranged by the depot, never by the
customer, so that the carnet stays valid.
5. Mobilisation

--- result 3: A06_nordic_service_addendum.docx  chunk 2 of 3  relevancy=0.0000  similarity=0.6670
5. Mobilisation
Offshore attendance in the region is mobilised through the customer's own vessel wherever one is available.
Where it is not, the depot charters through a local agent. Mobilisation requires offshore survival
certification current on the day of sailing, and the depot checks certification before booking.
6. Language
Service reports are written in English. On request, the depot provides a Norwegian summary of the findings and
the actions taken, prepared by the stores controller and checked by the attending engineer.
7. Subcontractors
Two subcontractors are approved for lifting and diving support in the region: Hordaland Subsea AS and Kattegat
Marine Services. Neither is authorised to open an instrument or to break a calibration seal.

====================================================================================================
4. region = nordic or uk
request body: {"question": "Which depot holds the Tolvan A3 loan pool?", "numResults": 5, "metadata-filters": [{"metadata.region": ["nordic", "uk"]}]}
response: HTTP 200, 5 results, answering file returned: YES

--- result 1: A05_depot_and_commissioning_note.md  chunk 0 of 2  relevancy=0.9999  similarity=0.7437
# Depot, spares and commissioning - working note

Bristol depot and UK commissioning engineers. Not a contractual document.

## The depot

The Bristol depot sits behind the workshop on the Avonmouth side and is open
07:00 to 17:00, Monday to Friday. Out of hours, the duty engineer holds a key
and may draw stock, recording what was taken on the ticket before leaving the
building.

## Loan stock

The Bristol depot holds the Tolvan A3 loan pool: six calibrated units reserved for Critical cover customers. A
loan unit goes out configured for the customer's
deployment, with a current certificate in the case, so that it can be rigged
without a bench check.

Loan units are issued against a signed loan note naming the ticket, the serial
number that went out and the serial number it stands in for. The stores
controller counts loan stock on the first working day of each month.

A customer on Standard or Extended cover may borrow a unit where one is free,
but has no reservation on it: a Critical cover customer takes precedence and the
borrowed unit is recalled with two working days' notice.

## Consumable stock

Anodes, anti-fouling guards and gland kits are held as rolling stock and
reordered at the reorder level marked on the bin. The stores controller reviews
reorder levels each quarter against the previous four quarters of consumption.

## Couriers

The courier cut-off is 15:30 for next-day delivery within the United Kingdom.
Anything handed over after the cut-off travels the following working day.
Dangerous goods - which means any lithium cell over the threshold on the
shipping matrix - need the packing declaration signed by a trained shipper, and
there are two in the building.

## What the depot does not do

The depot does not calibrate. An instrument that needs a certificate goes to the
laboratory, is booked in under its own job number, and comes back to the depot
only once the certificate has been signed.

## Commissioning: before travelling

--- result 2: A06_nordic_service_addendum.docx  chunk 0 of 3  relevancy=0.9676  similarity=0.7572
Nordic Service Addendum
Fenwake Instruments Ltd - Norway, Sweden and Denmark
1. What this addendum covers
This addendum sets out how service work is delivered for customers in Norway, Sweden and Denmark. It covers
logistics, customs, mobilisation, the regional depot and how loan stock is requested. It does not restate
commercial terms, and it does not describe the goods warranty carried by a new instrument.
2. Regional depot
The regional depot is at Bergen, on the Damsgard side of the harbour, and is open 07:00 to 16:00 local time,
Monday to Friday. It is staffed by two engineers and a stores controller.
2.1 What the depot holds
Item
Held at Bergen
Note

Brannoc loan pool
Two units
Issued against a signed loan note

Tolvan C5 spares kit
One full kit
Pressure housings, o-ring sets, end caps

Consumables
Rolling stock
Anodes, guards, gland kits

Deck cable, armoured
300 m drum
Cut to length on request

--- result 3: A06_nordic_service_addendum.docx  chunk 1 of 3  relevancy=0.2473  similarity=0.7651
Loan pool stock is counted on the first working day of each month and the count is sent to the service desk
lead the same day. A discrepancy is investigated before the next issue.
3. Requesting a loan unit
3.1 Who to call
Loan requests from customers in the region are met from the Bergen depot. Ring the depot rather than raising a
stores request in the system: the stores queue is worked from the workshop and adds a day to anything that
could have been handed over the counter.
3.2 What can be lent
The Bergen loan pool covers the Brannoc telemetry gateway. A gateway goes out with its own SIM and a
configuration file matching the customer's deployment. Where a customer needs an instrument the depot does not
hold as loan stock, the depot raises a request against central stores and tells the customer the same day what
can and cannot be met locally. Do not promise a loan unit before the depot has confirmed one is free.
3.3 The loan note
Every loan is recorded on a signed loan note carrying the ticket number, the serial number issued and the date
it is due back. Ten working days is the standard loan period, counted from the day the customer's own
instrument is returned to service. An overdue loan is chased by the stores controller at ten and at twenty
working days, and after that by the service desk lead.
3.4 Condition on return
A returned loan unit is inspected, cleaned and re-certified before it goes back into the pool. A unit returned
with a broken calibration seal is treated as damaged, quoted for repair, and does not go back into the pool
until the laboratory has passed it.
4. Customs and export
Instruments moving between the workshop and a Norwegian site travel under a temporary admission carnet. The
carnet number goes on the ticket before the instrument leaves the building; an instrument that travels without
one is held at the border and the ticket clock is suspended until it is released.
4.1 Repairs that cross a border
Where a repair cannot be completed at Bergen and the instrument must return to the workshop, the depot raises
a return note and the customer is told the same day. Return shipping is arranged by the depot, never by the
customer, so that the carnet stays valid.
5. Mobilisation

--- result 4: A06_nordic_service_addendum.docx  chunk 2 of 3  relevancy=0.0000  similarity=0.6670
5. Mobilisation
Offshore attendance in the region is mobilised through the customer's own vessel wherever one is available.
Where it is not, the depot charters through a local agent. Mobilisation requires offshore survival
certification current on the day of sailing, and the depot checks certification before booking.
6. Language
Service reports are written in English. On request, the depot provides a Norwegian summary of the findings and
the actions taken, prepared by the stores controller and checked by the attending engineer.
7. Subcontractors
Two subcontractors are approved for lifting and diving support in the region: Hordaland Subsea AS and Kattegat
Marine Services. Neither is authorised to open an instrument or to break a calibration seal.

--- result 5: A05_depot_and_commissioning_note.md  chunk 1 of 2  relevancy=0.0000  similarity=0.5965
## Commissioning: before travelling

Confirm the site permit is in place and that the structure is accessible at the
tide state you have planned for. Confirm the instrument's job number and that
the certificate in the case matches the serial number on the housing. Take the
torque wrench; the sensing face is the one part of this job that does not
tolerate improvisation.

## Commissioning: mounting

Mount the instrument on the mounting bracket with the sensing face pointing into
the flow, not across it. Leave at least 150 mm of clear water in front of the
face. On a structure with a grating, mount below the grating rather than through
it, so that the face is not shaded by a bar that will collect weed.

Bracket bolts are stainless M10, tightened to 22 Nm. Do not substitute a
galvanised bolt: the sacrificial anode is sized for the stainless arrangement
and the wrong metal in the water changes what corrodes.

## Commissioning: cable routing

Route the deck cable away from any winch path and secure it every 400 mm. Leave
a drip loop below the gland. Where the cable passes a sharp edge, fit the sleeve
from the gland kit rather than taping the cable. Do not coil surplus cable
against the instrument housing; surplus goes in a loose figure of eight on the
deck stand.

## Commissioning: checks before leaving site

With the instrument in the water and the gateway powered, confirm a reading
appears at the gateway within two minutes, and that the temperature reading is
within half a degree of a hand-held thermometer in the same water. Confirm the
salinity reading is stable over five minutes; a reading that wanders is usually
air trapped in the cell, cleared by lowering and raising the instrument twice.
Record the gateway signal strength on the commissioning sheet.

Leave the certificate in the site file, not in the instrument case. Leave one
spare gland kit and one spare anode with the site's own stores, and take the
packaging away.

Send back the signed commissioning sheet, photographs of the mounting from two
angles, and the serial numbers of anything fitted, on the same day. A
commissioning sheet that arrives a week later has usually lost the detail that
matters.

====================================================================================================
5. Control: origin = file-upload
request body: {"question": "Which depot holds the Tolvan A3 loan pool?", "numResults": 5, "metadata-filters": [{"origin": ["file-upload"]}]}
response: HTTP 200, 5 results, answering file returned: YES

--- result 1: A05_depot_and_commissioning_note.md  chunk 0 of 2  relevancy=0.9999  similarity=0.7437
# Depot, spares and commissioning - working note

Bristol depot and UK commissioning engineers. Not a contractual document.

## The depot

The Bristol depot sits behind the workshop on the Avonmouth side and is open
07:00 to 17:00, Monday to Friday. Out of hours, the duty engineer holds a key
and may draw stock, recording what was taken on the ticket before leaving the
building.

## Loan stock

The Bristol depot holds the Tolvan A3 loan pool: six calibrated units reserved for Critical cover customers. A
loan unit goes out configured for the customer's
deployment, with a current certificate in the case, so that it can be rigged
without a bench check.

Loan units are issued against a signed loan note naming the ticket, the serial
number that went out and the serial number it stands in for. The stores
controller counts loan stock on the first working day of each month.

A customer on Standard or Extended cover may borrow a unit where one is free,
but has no reservation on it: a Critical cover customer takes precedence and the
borrowed unit is recalled with two working days' notice.

## Consumable stock

Anodes, anti-fouling guards and gland kits are held as rolling stock and
reordered at the reorder level marked on the bin. The stores controller reviews
reorder levels each quarter against the previous four quarters of consumption.

## Couriers

The courier cut-off is 15:30 for next-day delivery within the United Kingdom.
Anything handed over after the cut-off travels the following working day.
Dangerous goods - which means any lithium cell over the threshold on the
shipping matrix - need the packing declaration signed by a trained shipper, and
there are two in the building.

## What the depot does not do

The depot does not calibrate. An instrument that needs a certificate goes to the
laboratory, is booked in under its own job number, and comes back to the depot
only once the certificate has been signed.

## Commissioning: before travelling

--- result 2: A06_nordic_service_addendum.docx  chunk 0 of 3  relevancy=0.9676  similarity=0.7572
Nordic Service Addendum
Fenwake Instruments Ltd - Norway, Sweden and Denmark
1. What this addendum covers
This addendum sets out how service work is delivered for customers in Norway, Sweden and Denmark. It covers
logistics, customs, mobilisation, the regional depot and how loan stock is requested. It does not restate
commercial terms, and it does not describe the goods warranty carried by a new instrument.
2. Regional depot
The regional depot is at Bergen, on the Damsgard side of the harbour, and is open 07:00 to 16:00 local time,
Monday to Friday. It is staffed by two engineers and a stores controller.
2.1 What the depot holds
Item
Held at Bergen
Note

Brannoc loan pool
Two units
Issued against a signed loan note

Tolvan C5 spares kit
One full kit
Pressure housings, o-ring sets, end caps

Consumables
Rolling stock
Anodes, guards, gland kits

Deck cable, armoured
300 m drum
Cut to length on request

--- result 3: A10_tolvan_a3_product_overview.md  chunk 0 of 2  relevancy=0.8302  similarity=0.7045
# Tolvan A3 - product overview

The Tolvan A3 is a conductivity and temperature sensor built for
continuous deployment in estuarine and coastal water. It is the instrument most
of our customers meet first, and most of the questions the service desk answers
are about this one.

## What it measures

The instrument reports conductivity, temperature and a derived practical
salinity. Conductivity is measured with an inductive cell, which has no exposed
electrodes to foul or to wear, and temperature with a thermistor mounted in the
same flow path so that the two readings describe the same parcel of water.
Pressure is not measured; where a depth record is needed, the instrument is
paired with a separate pressure sensor on the same mooring.

## Where it is used

Typical deployments are estuary monitoring for a regulator, intake monitoring
for a water treatment works, and baseline surveys ahead of construction in a
harbour. It is rated for continuous immersion to fifty metres. Deeper work uses
the Tolvan C5, which shares the sensing arrangement in a
pressure housing rated considerably deeper.

## How it is powered and read

On a mooring, the instrument runs from an internal battery pack and logs to
internal memory. On a cabled installation it is powered over the same cable
that carries its data, and reports continuously to the Brannoc
telemetry gateway, which forwards to the customer's own system. The two modes
are configured at commissioning and are not switched in the field.

## Fouling and cleaning

In estuarine water the practical limit on deployment is biological fouling
rather than power or memory. An anti-fouling guard and a sacrificial anode are
fitted at commissioning and replaced at each service visit. Customers in warm
or nutrient-rich water are advised to shorten the interval between visits
rather than to clean the sensing face themselves, because the inductive cell is
easily damaged by an abrasive.

## Calibration

Every instrument leaves the laboratory with a signed certificate recording the
as-found and as-left bias at four reference points across the working range.
The recommended recalibration interval for the Tolvan A3 is 22 months from the date of the last certificate.
An instrument returned early because of a
suspected drift is checked as found before anything is adjusted, so that the
drift can be quantified rather than merely corrected.

--- result 4: A06_nordic_service_addendum.docx  chunk 1 of 3  relevancy=0.2473  similarity=0.7651
Loan pool stock is counted on the first working day of each month and the count is sent to the service desk
lead the same day. A discrepancy is investigated before the next issue.
3. Requesting a loan unit
3.1 Who to call
Loan requests from customers in the region are met from the Bergen depot. Ring the depot rather than raising a
stores request in the system: the stores queue is worked from the workshop and adds a day to anything that
could have been handed over the counter.
3.2 What can be lent
The Bergen loan pool covers the Brannoc telemetry gateway. A gateway goes out with its own SIM and a
configuration file matching the customer's deployment. Where a customer needs an instrument the depot does not
hold as loan stock, the depot raises a request against central stores and tells the customer the same day what
can and cannot be met locally. Do not promise a loan unit before the depot has confirmed one is free.
3.3 The loan note
Every loan is recorded on a signed loan note carrying the ticket number, the serial number issued and the date
it is due back. Ten working days is the standard loan period, counted from the day the customer's own
instrument is returned to service. An overdue loan is chased by the stores controller at ten and at twenty
working days, and after that by the service desk lead.
3.4 Condition on return
A returned loan unit is inspected, cleaned and re-certified before it goes back into the pool. A unit returned
with a broken calibration seal is treated as damaged, quoted for repair, and does not go back into the pool
until the laboratory has passed it.
4. Customs and export
Instruments moving between the workshop and a Norwegian site travel under a temporary admission carnet. The
carnet number goes on the ticket before the instrument leaves the building; an instrument that travels without
one is held at the border and the ticket clock is suspended until it is released.
4.1 Repairs that cross a border
Where a repair cannot be completed at Bergen and the instrument must return to the workshop, the depot raises
a return note and the customer is told the same day. Return shipping is arranged by the depot, never by the
customer, so that the carnet stays valid.
5. Mobilisation

--- result 5: A06_nordic_service_addendum.docx  chunk 2 of 3  relevancy=0.0000  similarity=0.6670
5. Mobilisation
Offshore attendance in the region is mobilised through the customer's own vessel wherever one is available.
Where it is not, the depot charters through a local agent. Mobilisation requires offshore survival
certification current on the day of sailing, and the depot checks certification before booking.
6. Language
Service reports are written in English. On request, the depot provides a Norwegian summary of the findings and
the actions taken, prepared by the stores controller and checked by the attending engineer.
7. Subcontractors
Two subcontractors are approved for lifting and diving support in the region: Hordaland Subsea AS and Kattegat
Marine Services. Neither is authorised to open an instrument or to break a calibration seal.

====================================================================================================
6. region = nordic, no metadata. prefix
request body: {"question": "Which depot holds the Tolvan A3 loan pool?", "numResults": 5, "metadata-filters": [{"region": ["nordic"]}]}
response: HTTP 200, 0 results, answering file returned: NO
Expected vs. Found
✓Expected: Do not return the document containing the answer when the search is limited to a subset without that answer.Found: The Nordic-only search returned 3 passages from the Nordic service addendum and left out the UK document containing the answer.
Supporting proof
Proof 1Screenshot
Notebook screenshot: whether each of six searches returned the document containing the answer
Open original ↗
Why this result

The answering document was excluded, while related passages remained. Searches without the limit, within the answer's region, and across all uploaded files retrieved it. That distinguishes a respected restriction from an empty search or a filter that suppresses results generally.

Also observed in this test case

Silent filter typo. The Nordic-region search using a filter name without its required prefix returned 0 results, with a success status and no error.

Relevance and similarity diverge. The third Nordic passage received a relevance score of 0.0000 and a similarity score of 0.6670. Filtering on relevance alone would drop that returned passage.

Tested by Vivek Tomar · evidence dated 14 October 2026

Configuration and setup

How this tool was set up for the run and what the test needed in place. Each row is a fact from the run's records; a fact the records do not hold is left out, not guessed.

Software that produced the output
Vectorize.io
Build or version
v1 (Beta)
Surface
API
Set up before the run
A UK document had to hold the answer about the Tolvan A3 loan pool's depot; a separate, non-empty Nordic subset had to contain related Bergen depot and Brannoc loan-pool material.
Search
5 results · region filter with the custom-tag prefix
Answer document region
UK
Tested
14 October 2026 · Vivek Tomar

How this scenario is graded

How we decide Pass, Fail and Not gradable. The same rules apply to every tool tested on this scenario.

How results are decided

Each test case gets one result per tool: Pass, Fail or Not gradable. A test case we haven't run yet shows Untested. There are no partial results.

The rules
  • Pass: the tool did everything the test expected, and nothing it said contradicts the correct answer.
  • Fail: at least one expected behaviour clearly didn't happen; the test case's result says which one and quotes the tool.
  • Not gradable: our evidence couldn't settle the outcome (for example a record we needed is missing). It is never counted as a fail, and the test case's result says what's missing.

Where this sits in the benchmark

This page is one cell of a larger study: one tool, one scenario. Only this benchmark's frame appears here.

LevelNameScope
BenchmarkManaged RAG →15 scenarios · 9 tools
CapabilityRetrieval →
ScenarioRetrieval is scoped to part of the documents →
ToolVectorize.io →

History of this result

What has happened to this result since it was first published. Runs and grades are never overwritten: a retest or a re-grade publishes a new result and keeps the earlier one readable.

from the publication record
20 November 2026First publishedManaged RAG v1

Act on this result

Nothing filed here edits the run or the grade. A challenge opens a review, and a review can produce a new run or a re-grade — which becomes the current result and leaves this one in the history.

This matches what I see

You run the same kind of test against your own setup and get the same behaviour.

Agree →
This does not match

Yours behaves differently. Tell us what you got, with a screenshot if you have one.

Disagree →
Point out an issue

Something here is wrong — a reference value, a transcription, a grade.

Report an issue →
Request a retest

On a newer build, a larger dataset, or your own setup.

Request a retest →
We have fixed this

Tell us what changed and we schedule a rerun of the failing test case. The old result stays as history.

Vendor notice →
Filed against this evidenceNothing yet. Challenges, counter-evidence and fix notices appear here with their outcome, and stay on the page after they are resolved.
Cite this result
aidemos.com/benchmarks/managed-rag/results/vectorize-io/document-scoped-retrieval · 1 pass · 0 fail · coverage 1/1 · graded 2026-11-07

The same record is available as structured data through the AI Demos MCP server, with the counts, the coverage and every per-test-case reason carried as fields.

Verify the proof files

These files support this result. Open a file to inspect the original evidence.

Output file (text) ↗text/plain; charset=utf-8 · 36 KB
Proof 1 · Screenshot ↗image/png · 393 KB
File fingerprints (SHA-256)

A fingerprint identifies the exact file used for this result.

Output file (text)577c86aaaeafef6db2320f37078b774936723c62d5de4f5f948ea0e64c4e5069
Proof 1 · Screenshot52bd9293051f30afd1a9c60f6b242c4cafc5ba39efb49848fc0680553fdda60a