o g@sLddlmZddlmZddlmZddlmZeeZ GdddeZ dS)) getLogger)FusionAttentionClip) ModelProto) BertOnnxModelcs<eZdZd dededeffdd ZddZd d ZZS) ClipOnnxModelrmodel num_heads hidden_sizecs(tj|||dt||j|j|_dS)N)rr )super__init__rr rclip_attention_fusion)selfrrr  __class___/var/www/visachat/venv/lib/python3.10/site-packages/onnxruntime/transformers/onnx_model_clip.pyr szClipOnnxModel.__init__cCs@i}gd}|D] }||}t|||<qtd||S)z8 Returns node count of fused operators. ) AttentionGeluLayerNormalization QuickGeluSkipLayerNormalizationzOptimized operators:)get_nodes_by_op_typelenloggerinfo)r op_countopsopnodesrrrget_fused_operator_statisticss z+ClipOnnxModel.get_fused_operator_statisticscCs|jdS)N)r apply)r rrrfuse_attention'szClipOnnxModel.fuse_attention)rr) __name__ __module__ __qualname__rintr rr! __classcell__rrrrrsrN) loggingrfusion_attention_clipronnxronnx_model_bertrr"rrrrrrs