o 2i@sddlmZeddlZddlZddlZddlmZmZmZm Z ddl m Z m Z m Z mZmZmZddlmZddlmZddlmZmZddlmZdd lmZdd lmZddlZddl Z e!d Z"e!d d Z#e!d Z$e!ddZ%e!ddZ&ddl'm(Z(e(e$e&dZ'e!ddZ)ej*ej+dde,e-Z.e ddddZ/e/j0edgddgdgde/1ee/1eeZ2edfde3fd d!Z4Gd"d#d#eZ5Gd$d%d%eZ6Gd&d'd'eZ7Gd(d)d)eZ8Gd*d+d+eZ9Gd,d-d-eZ:Gd.d/d/eZ;Gd0d1d1eZGd6d7d7eZ?Gd8d9d9eZ@Gd:d;d;eZAGdd?d?eZCe/Dd@dAdBZEe/DdCdDdEZFe/GdFe e4fdGe5dHedIe3fdJdKZHe/GdLe e4fdGe6dHedIe3fdMdNZIe/GdOe e4fdGe7dHedIe3fdPdQZJe/GdRe e4fdGe8dHedIe3fdSdTZKe/GdUe e4fdGe9dIe3fdVdWZLe/GdXe e4fdGe:dHedIe3fdYdZZMe/Gd[e e4fdGe;dIe3fd\d]ZNe/Gd^e e4fdGedIe3fdjdkZRe/Gdle e4fdGe?dIe3fdmdnZSe/Gdoe e4fdGe@dHedIe3fdpdqZTe/Gdre e4fdGeAdIe3fdsdtZUe/Gdue e4fdGeBdHedIe3fdvdwZVe/Gdxe e4fdGeCdHedIe3fdydzZWe/Gd{e e4fdGe@dIe3fd|d}ZXe/Gd~e e4fdGeBdIe3fddZYe/Gde e4fdGeCdIe3fddZZe/Dde e4fde3dce3dIe3fddZ[e/Dde e4fde3dce3dIe3fddZ\e/Dde e4fde3dce3dIe3fddZ]e-dkr ddl^Z^e^j_e/ddddSdS)) load_dotenvN)DictListOptionalAny)FastAPI HTTPExceptionDependsHeaderRequestBackgroundTasks)CORSMiddleware)StreamingResponse) BaseModelField)MinaionsRFPService)routerANTHROPIC_API_KEYANTHROPIC_MODELzclaude-3-5-haiku-latestOPENAI_API_KEY OPENAI_MODELz Qwen/Qwen3-Next-80B-A3B-Instruct OPENAI_URLz#https://api.deepinfra.com/v1/openai)OpenAI)api_keybase_url GENAI_ENGINEclaudez4%(asctime)s - %(name)s - %(levelname)s - %(message)s)levelformatzTender Automation AI Enginez[AI Engine for Getting RFP Documents, RFP Analysis, and Bid Document Generation using Claude2.0.0)title descriptionversion*T) allow_originsallow_credentials allow_methods allow_headers x_api_keycs&|r |tjdkrtddd|S)NAI_SERVICE_API_KEYizInvalid API key status_codedetail)osenvirongetr)r(r0./var/www/html/minaions-tender/ai-engine/app.pyverify_api_key@s r2c@6eZdZUedddZeed<edddZeed<dS)GetRfpDocumentsRequest.z)Tender ID to get additional documents forr! tender_id Tenant ID tenant_idN)__name__ __module__ __qualname__rr6str__annotations__r8r0r0r0r1r4J r4c@JeZdZUedddZeed<edddZeed<edddZeed<d S) EstimateAnalysisCostRequest. Tender IDr5r6r7r8 Company ID company_idN) r9r:r;rr6r<r=r8rCr0r0r0r1r@O r@c@r?) AnalyzeRfpRequest.Analysis record IDr5 analysis_idr7r8rBrCN) r9r:r;rrGr<r=r8rCr0r0r0r1rEUrDrEc@VeZdZUedddZeed<edddZeed<edddZe e ee fed<d S) AnalyzeCompanyDocsRequest.r7r5r8rBrCz.List of companies documents with their details folder_listN) r9r:r;rr8r<r=rCrJrrrr0r0r0r1rI[ $rIc@rH) EstimateBidGenerationCostRequest.rFr5rGr7r8-List of required documents with their details required_docsN) r9r:r;rrGr<r=r8rNrrrr0r0r0r1rLarKrLc@sjeZdZUedddZeed<edddZeed<edddZe e ee fed<edd dZ eed <d S) GenerateBidDocumentsRequest.Bid generation record IDr5bid_generation_idr7r8rMrNrBrCN) r9r:r;rrQr<r=r8rNrrrrCr0r0r0r1rOgs  rOc@sreZdZUedddZeed<edddZeed<edddZeed<edd dZ eed <edd dZ eed <d S)RegenerateBidDocumentRequest.rPr5rQr7r8z2Document ID of the original document to regenerate document_idz$User's instructions for regeneration user_promptrBrCN) r9r:r;rrQr<r=r8rSrTrCr0r0r0r1rRn rRc@r3)SetupRfpChatRequest.rFr5rGr7r8N)r9r:r;rrGr<r=r8r0r0r0r1rVvr>rVc@sveZdZUedddZeed<edddZeed<edddZeed<edd dZ eed <ed d dZ e eed <d S)ChatWithRfpRequest.rFr5rGr7r8rAr6zUser's questionqueryNzClient session ID client_id) r9r:r;rrGr<r=r8r6rXrYrr0r0r0r1rWzs rWc@sFeZdZUeed<eZeeed<dZee ed<dZ ee ed<dS)ChatCompletionRequestpromptmodel max_tokensgffffff? temperatureN) r9r:r;r<r=rr\rr^intr_floatr0r0r0r1rZs rZc@s&eZdZUeed<dZeeed<dS)AnalyzeDocumentRequestfile_urltender document_typeN)r9r:r;r<r=rerr0r0r0r1rbs rbc@sreZdZUedddZeed<edddZeed<eeed<edd dZ e eeed <ed d dZ e ed <dS)MergeBidDocumentsRequest.rPr5rQr7r8generated_document_idsNz&List of document categories to includedocument_categoriesT)Whether to add page numbers to merged PDFadd_page_numbers) r9r:r;rrQr<r=r8rrhrrjboolr0r0r0r1rfs  rfc@sreZdZUedddZeed<edddZeed<edddZeed<ed d dZ e ed <ed d dZ e ed<dS)CompressDocumentRequest.rPr5rQzDocument ID to compressrSr7r825Target size as percentage of original (25, 50, or 75)target_size_percentT4Whether to prioritize quality over exact size targetpreserve_qualityN) r9r:r;rrQr<r=rSr8ror`rqrkr0r0r0r1rlrUrlc@szeZdZUedddZeed<edddZeed<edddZe ed <ed d dZ e ed <ed ddZ e eeed<d S)BatchCompressDocumentsRequest.rPr5rQr7r8rmrnroTrprqNz'List of document categories to compressrh)r9r:r;rrQr<r=r8ror`rqrkrhrrr0r0r0r1rrs  rrc@s^eZdZUedddZeed<edddZeed<edddZe ed <edd dZ e ed <d S) MergeTenderDocumentsRequest.rAr5r6r7r8Trirjz#Whether to include linked documentsinclude_linked_docsN) r9r:r;rr6r<r=r8rjrkrtr0r0r0r1rss rs/cs ddiS)Nmessagez+Tender Automation AI Engine v2.0 is runningr0r0r0r0r1rootsrwz/healthcs dddS)Nhealthyr)statusr"r0r0r0r0r1 health_checks rzz/get_rfp_documentsrequestbackground_tasksrc slz|tj|j|jdd|j|j|jdWSty5}ztd|tdt |dd}~ww)zKExtract links from existing RFP documents and download additional documents processingz-Getting additional RFP documents for tender: )ryrvr6r8zError getting RFP documents: r*N) add_taskserviceget_rfp_documentsr6r8 Exceptionloggererrorrr<r{r|rer0r0r1rs" rz/estimate_analysis_costc sxzt|j|j|j}|tj|j|j|j|dd|dWSty;}zt d|t dt |dd}~ww)z?Estimate the cost for RFP analysis based on document complexityr}z Analysis cost estimation startedryrvrGz Error estimating analysis cost: r~r*N) rcreate_analysis_placeholderr6r8rCr+process_analysis_cost_estimation_backgroundrrrrr<)r{r|rrGrr0r0r1estimate_analysis_costs& rz /analyze_rfpc sdz|tj|j|j|jdd|jdWSty1}ztd|t dt |dd}~ww)zFAnalyze RFP documents to extract key information and check eligibilityr}zRFP analysis startedrzError starting RFP analysis: r~r*N) rr analyze_rfprGr8rCrrrrr<rr0r0r1rs" rz/analyze_company_docsc sz*|tj|j|j|jtj|j|jddidtddiddd|jdWSt yK}zt d |t |t d t|d d }~ww) z4Analyze Company documents to extract key informationrydoc_analysis_in_progresslogs) timestampactionz$set$pushr}z!Company document analysis started)ryrvrCz*Error starting Company document analysis: r~r*N)rranalyze_company_docsr8rJrC api_clientupdate_company_infotimerrrprintrr<rr0r0r1rs4 rz/estimate_bid_generation_costc sVz t|j|j|j}|WSty*}ztd|tdt |dd}~ww)z-Estimate the cost for bid document generationz&Error estimating bid generation cost: r~r*N) restimate_bid_generation_costrGr8rNrrrrr<r{rresultrr0r0r1rAsrz/generate_bid_documentsc shz|tj|j|j|j|jdd|jdWSty3}zt d|t dt |dd}~ww)z9Generate complete bid documents using enhanced automationr}zBid document generation started)ryrvrQz(Error starting bid document generation: r~r*N) rrgenerate_bid_documentsrQr8rNrCrrrrr<rr0r0r1rRs$ rz/regenerate_bid_documentc ^zt|j|j|j|j|j}|WSty.}zt d|t dt |dd}~ww)z9Regenerate a specific bid document based on user feedbackz!Error regenerating bid document: r~r*N) rregenerate_bid_documentrQr8rSrTrCrrrrr<rr0r0r1rprz/setup_rfp_chatc sz|j}|j}tj|}|stdd|dt|d|kr*tdd|dt|d}tj||}|sBtd|d| di}| drXd | d d |d WStj |dd |ddt didt dd|ididtj |ddt dd|idii| tj||dd|d |ddWStyty} ztd| tdt| dd} ~ ww)z(Setup chat functionality for RFP queriesAnalysis record not found: r*tenantrdTender not found: chatSetupsetupCompletedalready_completedbidIdz Chat functionality already setup)rybid_idrvrG analysis_FT)rrsetupInProgress setupStartedrchat_setup_started started_by)rrdetailsrrr}z Chat setup started in background 2-5 minutes)ryrvrGrestimated_timezError starting chat setup: r~N)rGr8rr get_analysisrr< get_tender ValueErrorr/ update_tenderrupdate_analysisrsetup_rfp_chat_backgroundrrr) r{r|rrGr8analysisr6rd chat_setuprr0r0r1setup_rfp_chats|       rz /chat_setup_status/{analysis_id}rGr8c s^ztj|}|stdd|dt|d|kr$tdd|dt|d}tj||}|sMerge bid documents into a single PDF with index (synchronous)zError merging bid documents: r~r*N) rrrQr8rhrjrrrrr<rr0r0r1merge_bid_documents_syncBrz/batch_compress_documents_syncc r)zBBatch compress all PDF documents in a bid generation (synchronous)z#Error batch compressing documents: r~r*N) rr rQr8rorqrhrrrrr<rr0r0r1batch_compress_documents_syncTrrz/merge_tender_documents_syncc r)zIMerge all tender/RFP documents into a single PDF with index (synchronous)z Error merging tender documents: r~r*N) rr r6r8rjrtrrrrr<rr0r0r1merge_tender_documents_syncgrrz!/merge_status/{bid_generation_id}rQc sTztj||}|stddd|dg}|dg}dd|D}|rK|r0t|dd d nd }d ||r;|d nd |rF|ddWSd dWSdd|D}|rmt|dd d } d| d | diddWSdd|D} | rt| dd d } d| d ddWSdddWSty} ztd| tdt | dd } ~ ww)z*Get the status of document merge operationrBid generation not foundr*mergedDocumentsrcSg|] }|ddvr|qS)r)documents_merged merge_started merge_failedr/.0logr0r0r1  z$get_merge_status..cS |ddSNrrrxr0r0r1 z"get_merge_status..keyNrrr)rymerged_document_idsrrcSg|] }|ddkr|qS)rrrrr0r0r1rcSrr rr!r0r0r1r#r$rrryrrcSr()rrrrr0r0r1rr)cSrr rr!r0r0r1r#r$r}rryrrrz0No merge operation found for this bid generationryrvzError getting merge status: r~ rrget_bid_generationrr/maxrrrr<) rQr8rbid_gen merged_docsr merge_logs latest_merge failed_logslatest_failure started_logs latest_startrr0r0r1get_merge_statusysR    r8z*/batch_compress_status/{bid_generation_id}c s\ztj||}|stddd|dg}dd|D}dd|D}|rOt|dd d }d |d |d i|d idd|d idddWSdd|D}|rqt|dd d } d| d | d iddWSdd|D} | rt| dd d } d| d ddWSdddWSty} ztd| td t | dd!} ~ ww)"z-Get the status of batch compression operationrrr*rcSr)r)batch_documents_compressedbatch_compression_startedbatch_compression_failedrrr0r0r1rrz-get_batch_compress_status..cSr()rr9rrr0r0r1rr)cSrr rr!r0r0r1r#r$z+get_batch_compress_status..r%rrrcompressed_countroverall_compression_ratio)ryrrr<r=cSr()rr;rrr0r0r1rr)cSrr rr!r0r0r1r#r$rrr*cSr()rr:rrr0r0r1rr)cSrr rr!r0r0r1r#r$r}r r+rz$No batch compression operation foundr,z(Error getting batch compression status: r~Nr-) rQr8rr0r compress_logscompleted_logslatestr4r5r6r7rr0r0r1get_batch_compress_statussP     rAz/get_rfp_status/{tender_id}r6c s>ztj||}|stddd|dg}td|dd|D}td|t|D]J}|d }|d i}|d krhd |d |dd|ddd|ddd|ddddWS|dkr|d|d |dddWSq2dddWSty} zt d| tdt | dd} ~ ww) z-Get the status of get_rfp_documents operationrzTender not foundr*rz Logs found: cSr)r)linked_documents_addedget_rfp_documents_failedget_rfp_documents_completedrrr0r0r1r rz,get_rfp_documents_status..zFiltered RFP Logs: rrrDrr links_foundrdocuments_downloadedzProcess completed. Found z links, downloaded z additional documents)ryrrErFrvrCrrzRFP documents extraction failed)ryrrrvr}z0Still processing... Check again in a few minutesr,z$Error getting RFP documents status: r~N) rrrrr/rinforeversedrrr<) r6r8rrdrrfp_logsrrrrr0r0r1get_rfp_documents_statussH           rJ__main__z0.0.0.0i@)hostport)`dotenvrr-rloggingtypingrrrrfastapirrr r r r fastapi.middleware.corsr fastapi.responsesrpydanticrrminaions_rfp_servicerbid_processing_apisrbid_processing_routerlocation_finder_apilocation_finder_routerasynciorgetenvrrrrrrrr basicConfigINFO getLoggerr9rappadd_middlewareinclude_routerrr<r2r4r@rErIrLrOrRrVrWrZrbrfrlrrrsr/rwrzpostrrrrrrrrrrrrrr r r rrrr8rArJuvicornrunr0r0r0r1s                     ! ! '    X G   k %       < @ :