Enable setting resource_class or resources when calling query() on IVFFlatIndex

[jparismorgan]

What

Adds resource_class and resources to query(). These are only valid for Mode.REALTIME and Mode.BATCH. If not provided, the default is large. You cannot pass both resource_class and resources.

Testing

• Adds unit tests checking that we throw exceptions when we should and succeed otherwise.
• I manually looked at what machine we ran on for each scenario and things look okay, but I didn't see a nice path to testing this programmatically, though please do let me know if I just missed it :

index.query(query_vectors, k=k, nprobe=nprobe, mode=Mode.REALTIME, resource_class="standard")

index.query(query_vectors, k=k, nprobe=nprobe, mode=Mode.REALTIME)

index.query(query_vectors, k=k, nprobe=nprobe, mode=Mode.BATCH, resource_class="standard")

index.query(query_vectors, k=k, nprobe=nprobe, mode=Mode.BATCH)

resources = {"cpu": "9", "memory": "12Gi", "gpu": 0}
index.query(query_vectors, k=k, nprobe=nprobe, mode=Mode.BATCH, resources=resources)

[NikolaosPapailiou]

nit: Can only be used in BATCH mode

[jparismorgan]

Oops thanks, good catch, updated.

[NikolaosPapailiou]

Duplicate documentation for num_partitions

[jparismorgan]

Thanks, good catch, removed.

[NikolaosPapailiou]

same as above, only BATCH mode

[jparismorgan]

Thanks, done.

[NikolaosPapailiou]

Add a check to make sure that resources is not defined for REALTIME

[jparismorgan]

Sure, done. Originally I just let tiledb.cloud throw this error, but you're right, that's inconsistent with how I'm handling other errors, so updated.

[jparismorgan]

@lums658 / @ihnorton going to merge this, but adding you as reviewers so you can take a look after the fact. Please let me know any suggestions and I'll address them in a follow-up.