U Zh4@sddlmZddlZddlmZmZmZmZddlm Z m Z ddl m Z m Z mZddlZddlZddlmZddlmZdd lmZmZmZmZmZmZdd lmZmZmZdd l m!Z!dd l"m#Z#m$Z$dd l%m&Z&m'Z'ddl(m)Z)m*Z*ddl+m,Z,m-Z-ddl.m/Z/ddl0m1Z1m2Z2ddl3mZddl4m5Z5ddl6m7Z7ddgZ8Gddde#Z9Gddde$Z:GdddZ;GdddZdS) ) annotationsN)DictListIterableOptional)UnionLiteral)FutureThreadPoolExecutor as_completed)_legacy_response)FileChunkingStrategyParam) NOT_GIVENBodyQueryHeadersNotGiven FileTypes)is_givenmaybe_transformasync_maybe_transform)cached_property)SyncAPIResourceAsyncAPIResource)to_streamed_response_wrapper"async_to_streamed_response_wrapper)SyncCursorPageAsyncCursorPage)AsyncPaginatormake_request_options) FileObject)file_batch_create_paramsfile_batch_list_files_params)VectorStoreFile)VectorStoreFileBatch FileBatchesAsyncFileBatchesc@sBeZdZeddddZeddddZeeddded d d d d dddddd ddZdddedd d ddddddddZdddedd d ddddddddZ eedd d dd dddd Z eeeeeddded! d d d"d"d#dd$ddddd%d& d'd(Z ed)d d ddd*d+d,Z d-geed.d d/d0d dd dd1d2d3Z dS)4r&FileBatchesWithRawResponsereturncCst|Sa This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content. For more information, see https://www.github.com/openai/openai-python#accessing-raw-response-data-eg-headers )r(selfr.O/tmp/pip-unpacked-wheel-693nel7n/openai/resources/vector_stores/file_batches.pywith_raw_response szFileBatches.with_raw_response FileBatchesWithStreamingResponsecCst|Sz An alternative to `.with_raw_response` that doesn't eagerly read the response body. For more information, see https://www.github.com/openai/openai-python#with_streaming_response )r1r,r.r.r/with_streaming_response*sz#FileBatches.with_streaming_responseN attributeschunking_strategy extra_headers extra_query extra_bodytimeoutstr List[str]7Optional[Dict[str, Union[str, float, bool]]] | NotGiven$FileChunkingStrategyParam | NotGivenHeaders | None Query | None Body | None'float | httpx.Timeout | None | NotGivenr% vector_store_idfile_idsr5r6r7r8r9r:r*c CsX|std|ddi|pi}|jd|dt|||dtjt||||dtdS)  Create a vector store file batch. Args: file_ids: A list of [File](https://platform.openai.com/docs/api-reference/files) IDs that the vector store should use. Useful for tools like `file_search` that can access files. attributes: Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard. Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters, booleans, or numbers. chunking_strategy: The chunking strategy used to chunk the file(s). If not set, will use the `auto` strategy. Only applicable if `file_ids` is non-empty. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds >Expected a non-empty value for `vector_store_id` but received OpenAI-Beta assistants=v2/vector_stores/ /file_batchesrEr5r6r7r8r9r:bodyoptionscast_to) ValueError_postrr"FileBatchCreateParamsr r% r-rDrEr5r6r7r8r9r:r.r.r/create3s(' zFileBatches.createrMbatch_idrDr7r8r9r:r*cCs\|std||s$td|ddi|p0i}|jd|d|t||||dtdS) X Retrieves a vector store file batch. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rG7Expected a non-empty value for `batch_id` but received rHrIrJ/file_batches/rMrPrQrR_getr r%r-rXrDr7r8r9r:r.r.r/retrievemszFileBatches.retrievecCs^|std||s$td|ddi|p0i}|jd|d|dt||||dtd S) Cancel a vector store file batch. This attempts to cancel the processing of files in this batch as soon as possible. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rGrZrHrIrJr[/cancelrMr\rRrSr r%r_r.r.r/cancelszFileBatches.cancelpoll_interval_msr6int | NotGivenrDrErfr6r*cCs"|j|||d}|j|j||dS)ICreate a vector store batch and poll until all files have been processed.rDrEr6rDrfrVpollidr-rDrErfr6batchr.r.r/create_and_polls zFileBatches.create_and_poll afterbeforefilterlimitorderr7r8r9r:str | NotGivenGLiteral[('in_progress', 'completed', 'failed', 'cancelled')] | NotGiven#Literal[('asc', 'desc')] | NotGivenzSyncCursorPage[VectorStoreFile] rXrDrsrtrurvrwr7r8r9r:r*c Csz|std||s$td|ddi|p0i}|jd|d|dttt|| | | t|||||dtjd td S a Returns a list of vector store files in a batch. Args: after: A cursor for use in pagination. `after` is an object ID that defines your place in the list. For instance, if you make a list request and receive 100 objects, ending with obj_foo, your subsequent call can include after=obj_foo in order to fetch the next page of the list. before: A cursor for use in pagination. `before` is an object ID that defines your place in the list. For instance, if you make a list request and receive 100 objects, starting with obj_foo, your subsequent call can include before=obj_foo in order to fetch the previous page of the list. filter: Filter by file status. One of `in_progress`, `completed`, `failed`, `cancelled`. limit: A limit on the number of objects to be returned. Limit can range between 1 and 100, and the default is 20. order: Sort order by the `created_at` timestamp of the objects. `asc` for ascending order and `desc` for descending order. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rGrZrHrIrJr[z/files)rsrtrurvrw)r7r8r9r:query)pagerPmodel)rR _get_api_listrr$r rr#FileBatchListFilesParams r-rXrDrsrtrurvrwr7r8r9r:r.r.r/ list_filess2/zFileBatches.list_filesrfrXrDrfr*cCsddi}t|rt||d<|jj|||d}|}|jjdkr|t|sl|jd}|dk rht |}nd}| |dq|S) Wait for the given file batch to be processed. Note: this will return even if one of the files failed to process, you need to check batch.file_counts.failed_count to handle this case. X-Stainless-Poll-Helpertrue X-Stainless-Custom-Poll-IntervalrDr7ropenai-poll-after-msN rr;r0r`parseZ file_countsZ in_progressheadersgetintZ_sleepr-rXrDrfrresponserpZ from_headerr.r.r/rms$     zFileBatches.pollmax_concurrencyrErfr6Iterable[FileTypes]rrDfilesrrErfr6r*c s~g}t|dfdd|D}W5QRXt|D]"} | } | rJ| || q6j||dd|D||d} | S)Uploads the given files concurrently and then creates a vector store file batch. If you've already uploaded certain files that you want to include in this batch then you can pass their IDs through the `file_ids` argument. By default, if any file upload fails then an exception will be eagerly raised. The number of concurrency uploads is configurable using the `max_concurrency` parameter. Note: this method only supports `asyncio` or `trio` as the backing async runtime. ) max_workerscs"g|]}jjjj|ddqS) assistantsfilepurpose)Zsubmit_clientrrV.0rexecutorr-r.r/ Ws z/FileBatches.upload_and_poll..css|] }|jVqdSNrnrfr.r.r/ isz.FileBatches.upload_and_poll..rDrErfr6)r r exceptionappendresultrq) r-rDrrrErfr6resultsZfuturesfutureexcrpr.rr/upload_and_poll=s"   zFileBatches.upload_and_poll__name__ __module__ __qualname__rr0r3rrVr`rdrqrrmrr.r.r.r/r&sR  "A,,(O*c@sBeZdZeddddZeddddZeeddded d d d d dddddd ddZdddedd d ddddddddZdddedd d ddddddddZ eedd d dd dddd Z eeeeeddded! d d d"d"d#dd$ddddd%d& d'd(Z ed)d d ddd*d+d,Z d-geed.d d/d0d dd dd1d2d3Z dS)4r'AsyncFileBatchesWithRawResponser)cCst|Sr+)rr,r.r.r/r0qsz"AsyncFileBatches.with_raw_response%AsyncFileBatchesWithStreamingResponsecCst|Sr2)rr,r.r.r/r3{sz(AsyncFileBatches.with_streaming_responseNr4r;r<r=r>r?r@rArBr%rCc sd|std|ddi|pi}|jd|dt|||dtjIdHt||||dtd IdHS) rFrGrHrIrJrKrLNrMrN)rRrSrr"rTr r%rUr.r.r/rVs(' zAsyncFileBatches.createrMrWcsb|std||s$td|ddi|p0i}|jd|d|t||||dtdId HS) rYrGrZrHrIrJr[rMr\Nr]r_r.r.r/r`szAsyncFileBatches.retrievecsd|std||s$td|ddi|p0i}|jd|d|dt||||dtd Id HS) rarGrZrHrIrJr[rbrMr\Nrcr_r.r.r/rdszAsyncFileBatches.cancelrergrhcs.|j|||dIdH}|j|j||dIdHS)rirjNrkrlror.r.r/rq s  z AsyncFileBatches.create_and_pollrrrxryrzzAAsyncPaginator[VectorStoreFile, AsyncCursorPage[VectorStoreFile]]r{c Csz|std||s$td|ddi|p0i}|jd|d|dttt|| | | t|||||dtjd td Sr|)rRrrr$r rr#rrr.r.r/rs2/zAsyncFileBatches.list_filesrrcsddi}t|rt||d<|jj|||dIdH}|}|jjdkrt|sr|jd}|dk rnt |}nd}| |dIdHq|S) rrrrrNrrrrrr.r.r/rmis$      zAsyncFileBatches.pollrrrrrc sgt}|dkr\ddddfdd t|fdd |D}tj|Id Hn~|d krd d l} d dddfdd } | |} | 4Id H} |D]} | | | | qW5QId HRXnt d|dj ||ddD||dId H}|S)rasynciozasyncio.SemaphorerNone) semaphorerr*c sD|4IdH(jjj|ddIdH}|W5QIdHRXdSNrrrrrVr)rrfile_objr-uploaded_filesr.r/asyncio_upload_files  z=AsyncFileBatches.upload_and_poll..asyncio_upload_filecsg|]}|qSr.r.r)rrr.r/rsz4AsyncFileBatches.upload_and_poll..Ntriorztrio.CapacityLimiter)limiterrr*c sD|4IdH(jjj|ddIdH}|W5QIdHRXdSrr)rrrrr.r/trio_upload_files  z:AsyncFileBatches.upload_and_poll..trio_upload_filezAsync runtime z8 is not supported yet. Only asyncio or trio is supportedcss|] }|jVqdSrrrr.r.r/rsz3AsyncFileBatches.upload_and_poll..r) sniffioZcurrent_async_libraryr SemaphoreZgatherrZCapacityLimiterZ open_nurseryZ start_soon RuntimeErrorrq)r-rDrrrErfr6Z async_libraryZtasksrrrZnurseryrrpr.)rr-rrr/rs0  "  z AsyncFileBatches.upload_and_pollrr.r.r.r/r'psR  "A,,(O*c@seZdZdddddZdS)r(r&r file_batchesr*cCsB||_t|j|_t|j|_t|j|_t|j|_dSr) _file_batchesr Zto_raw_response_wrapperrVr`rdrr-rr.r.r/__init__sz#FileBatchesWithRawResponse.__init__Nrrrrr.r.r.r/r(sr(c@seZdZdddddZdS)rr'rrcCsB||_t|j|_t|j|_t|j|_t|j|_dSr)rr Zasync_to_raw_response_wrapperrVr`rdrrr.r.r/rsz(AsyncFileBatchesWithRawResponse.__init__Nrr.r.r.r/rsrc@seZdZdddddZdS)r1r&rrcCs:||_t|j|_t|j|_t|j|_t|j|_dSr)rrrVr`rdrrr.r.r/rsz)FileBatchesWithStreamingResponse.__init__Nrr.r.r.r/r1sr1c@seZdZdddddZdS)rr'rrcCs:||_t|j|_t|j|_t|j|_t|j|_dSr)rrrVr`rdrrr.r.r/rsz.AsyncFileBatchesWithStreamingResponse.__init__Nrr.r.r.r/rsr)? __future__rrtypingrrrrZtyping_extensionsrrconcurrent.futuresr r r Zhttpxrr typesr_typesrrrrrr_utilsrrr_compatrZ _resourcerr _responserrZ paginationrrZ _base_clientrr Ztypes.file_objectr!Ztypes.vector_storesr"r#Z"types.file_chunking_strategy_paramZ%types.vector_stores.vector_store_filer$Z+types.vector_stores.vector_store_file_batchr%__all__r&r'r(rr1rr.r.r.r/s>         Sj