o g #@sddlZddlZddlmZmZmZz ddlZddlZWn ey'e dwddl m Z m Z m Z ddlmZGdddejZGdd d ejjjZGd d d ejjjjZGd d d ejjjZdS)N)AnyDictOptionalzGPlease install the OpenAI SDK to use this feature: 'pip install openai')call_llm_and_track_usage_asyncget_model_paramswith_privacy_mode)Clientcs0eZdZUdZeed<deffdd ZZS) AsyncOpenAIzf An async wrapper around the OpenAI SDK that automatically sends LLM usage events to PostHog. _ph_clientposthog_clientc s0tjdi|||_t||_t||_dS)z Args: api_key: OpenAI API key. posthog_client: If provided, events will be captured via this client instance. **openai_config: Additional keyword args (e.g. organization="xxx"). N)super__init__r WrappedChatchatWrappedEmbeddings embeddings)selfr kwargs __class__r U/var/www/visachat/venv/lib/python3.10/site-packages/posthog/ai/openai/openai_async.pyrs zAsyncOpenAI.__init__)__name__ __module__ __qualname____doc__ PostHogClient__annotations__r __classcell__r r rrr s r c@s"eZdZUeed<eddZdS)r_clientcCs t|jS)N)WrappedCompletionsr)rr r r completions&s zWrappedChat.completionsN)rrrr rpropertyr!r r r rr#s rcseZdZUeed<     ddeedeedeeeefde deeeefd ef fd d Z  ddeedeedeeeefde deeeefd ef fd d Z deedeedeeeefde deeeefd eeefdeee fde defddZZS)r rNFposthog_distinct_idposthog_trace_idposthog_propertiesposthog_privacy_modeposthog_groupsrcsp|dur t}|ddr|j|||||fi|IdHSt||jjd|||jjtj fi|IdH}|S)NstreamFopenai) uuiduuid4get_create_streamingrrr base_urlr create)rr#r$r%r&r'rresponserr rr/.s2      zWrappedCompletions.createc slt i gdvrid<ddd<tjdiIdH f dd}|S)Nstream_optionsT include_usagecsz[2z73dHWtdrjrfdddD tdr8jr8tjdkr8jdjj}|r8|Vq6Wt}| }d}  || IdHdSt}| }d}  || IdHw)Nusagecsi|] }|tj|dqS)r)getattrr3).0kchunkr r gszQWrappedCompletions._create_streaming..async_generator..) prompt_tokenscompletion_tokens total_tokenschoicesr) hasattrr3r=lendeltacontentappendtimejoin_capture_streaming_event)rBend_timelatencyoutput accumulated_contentrr#r'r&r%r$r0r start_time usage_statsr7rasync_generatorbsR     z=WrappedCompletions._create_streaming..async_generatorr )rDr r/)rr#r$r%r&r'rrNrrJrr-Qs   $z$WrappedCompletions._create_streamingrMrHrIc s|dur t}d|dt|t|jj||dt|jj|| ddgd|dd|d d||t|jjd |} |durEd | d <t |jjd r[|jjj |pS|d| |ddSdS)Nr)modelmessages assistant)rBroler:rr;) $ai_provider $ai_modelz$ai_model_parameters $ai_inputz$ai_output_choices$ai_http_status$ai_input_tokensz$ai_output_tokens $ai_latency $ai_trace_id $ai_base_urlF$process_person_profilecapturez$ai_generation distinct_idevent propertiesgroups) r*r+r,rrrr strr.r?r]) rr#r$r%r&r'rrMrHrIevent_propertiesr r rrFs>      z+WrappedCompletions._capture_streaming_eventNNNFN)FN)rrrr rrrcrrboolr/r-intfloatrFrr r rrr +sl (7    r csleZdZUeed<     d deedeedeeeefde deeeefd ef fd d Z Z S) rrNFr#r$r%r&r'rc s|dur t}t}tjdi|IdH}t} i} t|dr6|jr6t|jddt|jddd} | |} d|dt |j j ||d d | dd| |t |j j d |} |durcd | d <t|j j drw|j j j|pq|d| |d|S)a Create an embedding using OpenAI's 'embeddings.create' method, but also track usage in PostHog. Args: posthog_distinct_id: Optional ID to associate with the usage event. posthog_trace_id: Optional trace UUID for linking events. posthog_properties: Optional dictionary of extra properties to include in the event. posthog_privacy_mode: Whether to store input and output in PostHog. posthog_groups: Optional dictionary of groups to include in the event. **kwargs: Any additional parameters for the OpenAI Embeddings API. Returns: The response from OpenAI's embeddings.create call. Nr3r:rr<)r:r<r)rOinputrS)rTrUrVrWrXrYrZr[Fr\r]z $ai_embeddingr^r )r*r+rDr r/r?r3r4r,rrr rcr.r]) rr#r$r%r&r'rrLr0rGrMrHrdrr rr/sB      zWrappedEmbeddings.createre) rrrr rrrcrrrfr/rr r rrrs( r)rDr*typingrrrr)openai.resources ImportErrorModuleNotFoundErrorposthog.ai.utilsrrrposthog.clientrrr resourcesr AsyncChatrr!AsyncCompletionsr rAsyncEmbeddingsrr r r rs