U hfB@s@dZddlmZddlZddlZddlmZmZmZm Z m Z m Z m Z ddl mZddl mZddl mZddl mZdd l mZdd l mZdd l mZeejejgefZd d d dddZdddddZejGdddZddddddZGdddee ejgejfejd Z Gd!d"d"e Z!Gd#d$d$e Z"dS)%z LLMFunction.) annotationsN) AbstractSetAnyCallableIterableMappingOptionalSequence)llmfn_input_utils)llmfn_output_row) llmfn_outputs)llmfn_post_process)llmfn_post_process_cmds)model) prompt_utilsz#llmfn_output_row.LLMFnOutputRowViewbool)lhsrhsreturncCs||kS)z-Default function used when comparing outputs.)Z result_value)rrrQ/tmp/pip-unpacked-wheel-doshhd5e/google/generativeai/notebook/lib/llm_function.py _is_equal_fn+srzYCallable[[llmfn_output_row.LLMFnOutputRowView, llmfn_output_row.LLMFnOutputRowView], Any]4llmfn_post_process.LLMCompareFnPostProcessBatchAddFn)fnrcsdddfdd }|S)z1Vectorize a single-row-based comparison function.zYSequence[tuple[llmfn_output_row.LLMFnOutputRowView, llmfn_output_row.LLMFnOutputRowView]]z Sequence[Any])lhs_and_rhs_rowsrcsfdd|DS)Ncsg|]\}}||qSrr).0rrrrr FszD_convert_compare_fn_to_batch_add_fn.._fn..r)rrrr_fn>sz0_convert_compare_fn_to_batch_add_fn.._fnr)rrrrr#_convert_compare_fn_to_batch_add_fn3s  rc@s6eZdZUded<ded<ded<ded<ded<d S) _PromptInfoint prompt_numstrprompt input_numzMapping[str, str] prompt_vars model_inputN)__name__ __module__ __qualname____annotations__rrrrr Ks r Sequence[str]*llmfn_input_utils.LLMFunctionInputs | NonezIterable[_PromptInfo])promptsinputsrc cshg}|dk rt|}|s ig}t|D]:\}}t|D](\}}|jf|}t|||||dVq8q(dS)a Generate a tuple of fields needed for processing prompts. Args: prompts: A list of prompts, with optional keyword placeholders. inputs: A list of key/value pairs to substitute into placeholders in `prompts`. Yields: A _PromptInfo instance. N)r"r$r%r&r')r Zto_normalized_inputs enumerateformatr )r.r/Znormalized_inputsr"r$r%r&r'rrr_generate_promptsTs   r2c@seZdZdZdddddZejddd d Zejd d d ddZdd dd ddZ ddddddZ ddddddZ ddddddZ dS) LLMFunctionz6Base class for LLMFunctionImpl and LLMCompareFunction.N3Callable[[llmfn_outputs.LLMFnOutputs], None] | Noneoutputs_ipython_display_fncCsg|_||_dS)zConstructor. Args: outputs_ipython_display_fn: Optional function that will be used to override how the outputs of this LLMFunction will be displayed in a notebook (See further documentation in LLMFnOutputs.__init__().) N)_post_process_cmds_outputs_ipython_display_fn)selfr6rrr__init__szLLMFunction.__init__AbstractSet[str]rcCsdS)zLReturns the placeholders that should be present in inputs for this function.Nrr9rrrget_placeholdersszLLMFunction.get_placeholdersr-(Sequence[llmfn_outputs.LLMFnOutputEntry]r/rcCsdS)z&Concrete implementation of __call__().Nr)r9r/rrr _call_implszLLMFunction._call_implzllmfn_outputs.LLMFnOutputscCs||}tj||jdS)z+Runs and returns results based on `inputs`.)outputsZipython_display_fn)rAr LLMFnOutputsr8)r9r/rBrrr__call__s  zLLMFunction.__call__r#z1llmfn_post_process.LLMFnPostProcessBatchReorderFnnamerrcCs|jtj||d|SNrFr)r7appendrZLLMFnPostProcessReorderCommandr9rFrrrradd_post_process_reorder_fns z'LLMFunction.add_post_process_reorder_fnz-llmfn_post_process.LLMFnPostProcessBatchAddFncCs|jtj||d|SrG)r7rIrZLLMFnPostProcessAddCommandrJrrradd_post_process_add_fns z#LLMFunction.add_post_process_add_fnz1llmfn_post_process.LLMFnPostProcessBatchReplaceFncCs|jtj||d|SrG)r7rIrZLLMFnPostProcessReplaceCommandrJrrradd_post_process_replace_fns z'LLMFunction.add_post_process_replace_fn)N)N) r(r)r*__doc__r:abcabstractmethodr>rArDrKrLrMrrrrr3vs  r3) metaclasscs\eZdZdZddddddfdd Zd d d d d ZddddZdddddZZS)LLMFunctionImplaCallable class that executes the contents of a Magics cell. An LLMFunction is constructed from the Magics command line and cell contents specified by the user. It is defined by: - A model instance, - Model arguments - A prompt template (e.g. "the opposite of hot is {word}") with an optional keyword placeholder. The LLMFunction takes as its input a sequence of dictionaries containing values for keyword replacement, e.g. [{"word": "hot"}, {"word": "tall"}]. This will cause the model to be executed with the following prompts: "The opposite of hot is" "The opposite of tall is" The results will be returned in a LLMFnOutputs instance. Nzmodel_lib.AbstractModelr,zmodel_lib.ModelArguments | Noner4)rr. model_argsr6cs^tj|d||_||_|dkr*tn||_ti|_|jD]}|j t ||_q@dS)aConstructor. Args: model: The model that the prompts will execute on. prompts: A sequence of prompt templates with optional placeholders. The placeholders will be replaced by the inputs passed into this function. model_args: Optional set of model arguments to configure how the model executes the prompts. outputs_ipython_display_fn: See documentation in LLMFunction.__init__(). r5N) superr:_model_prompts model_libZModelArguments _model_args frozenset _placeholdersunionrr>)r9rr.rSr6r$ __class__rrr:s  zLLMFunctionImpl.__init__)Sequence[llmfn_output_row.LLMFnOutputRow])resultsrc Cs|jD]}z0t|tjr$||}ntdt|Wqtjk rRYqt k r}z"td| t|j |W5d}~XYqXq|Sz-Runs post-processing commands over `results`.z)Unsupported post-process command type: {}z Error executing "{}", got {}: {}N) r7 isinstancerLLMFnImplPostProcessCommandrunr PostProcessExecutionErrorr1type RuntimeErrorrFr()r9r_cmderrr_run_post_processing_cmdss$    z)LLMFunctionImpl._run_post_processing_cmdsr;r<cCs|jSNrZr=rrrr> sz LLMFunctionImpl.get_placeholdersr-r?r@c Csg}t|j|dD]}|jj|j|jd}g}t|jD],\}}|t j t j j |t j j|itdq8|t j|j|j|j|j|j|||dq|S)N)r.r/)r'rSdataZ result_type)r"r%r$r&r' model_results output_rows)r2rVrUZ call_modelr'rXr0Z text_resultsrIr LLMFnOutputRowr ColumnNames RESULT_NUMZ TEXT_RESULTr#LLMFnOutputEntryr"r%r$r&ri)r9r/r_infornro result_numZ text_resultrrrrAs<  zLLMFunctionImpl._call_impl)NN) r(r)r*rNr:rir>rA __classcell__rrr\rrRs rRcsreZdZdZddddddfdd Zd d d d d d d Zd dddZdddddZddddddZZ S)LLMCompareFunctionzzLLMFunction for comparisons. LLMCompareFunction runs an input over a pair of LLMFunctions and compares the result. Nztuple[str, LLMFunction]z&Sequence[tuple[str, CompareFn]] | Noner4)lhs_name_and_fnrhs_name_and_fncompare_name_and_fnsr6cstj|d|d|_|d|_|d|_|d|_t|j|j|_ |sdd|_ t |_ n@|d\}}||_ ||_ |ddD]\}}|j |t|dqdS)aConstructor. Args: lhs_name_and_fn: Name and function for the left-hand side of the comparison. rhs_name_and_fn: Name and function for the right-hand side of the comparison. compare_name_and_fns: Optional names and functions for comparing the results of the left- and right-hand sides. outputs_ipython_display_fn: See documentation in LLMFunction.__init__(). r5rZis_equalNrH)rTr: _lhs_name_lhs_fn _rhs_name_rhs_fnrYr>r[rZ _result_namer_result_compare_fnadd_compare_post_process_add_fnr)r9rxryrzr6rFrZcmp_fnr\rrr:6s&     zLLMCompareFunction.__init__r^)lhs_output_rowsrhs_output_rowsr_rc Cs|jD]}zRt|tjr$||}n6t|tjrH|tt|||}ntd t |Wqt j k rtYqtk r}z"t d | t |j|W5d}~XYqXq|Sr`)r7rarrbrcZLLMCompareFnPostProcessCommandlistziprfr1rer rdrFr()r9rrr_rgrhrrrribs2    z,LLMCompareFunction._run_post_processing_cmdsr;r<cCs|jSrjrkr=rrrr>sz#LLMCompareFunction.get_placeholdersr-r?r@c Cs||}||}g}t||D]\}}|j|jkrLtd|j|j|j|jkrltd|j|j|j|jkrtd|j|jtt |j t |j }|j d|}|j d|} g} t t|| D]\} } | \} }t j j| |j|| |i}tj|td}|t j j|j|j| f|j|ffD]@\}}|D],\}}|t j jkr>|d|||q>q.| |q|t j|j|j|j|j|| | ddq"|S)NzPrompt num mismatch: {} vs {}zInput num mismatch: {} vs {}zPrompt vars mismatch: {} vs {}rlz{}_{})rrr_)r"r%r&ro)r~rrr"rfr1r%r&minlenror0r rqrrrrr rpraddZ PROMPT_VARSr}ritemsrIrsri)r9r/Z lhs_resultsZ rhs_resultsrBZ lhs_entryZ rhs_entryZnum_output_rowsrrroruZlhs_and_rhs_output_rowZlhs_output_rowZrhs_output_rowZrow_dataZ output_rowrFrowkvrrrrAs           zLLMCompareFunction._call_implr#rr3rEcCs|jtj||d|SrG)r7rIrZ!LLMCompareFnPostProcessAddCommandrJrrrrsz2LLMCompareFunction.add_compare_post_process_add_fn)NN) r(r)r*rNr:rir>rArrvrrr\rrw/s ,Zrw)#rN __future__rrOZ dataclassestypingrrrrrrr Z google.generativeai.notebook.libr r r r rrrWrZLLMFnOutputRowViewZ CompareFnrrZ dataclassr r2ZLLMFunctionInputsrCABCMetar3rRrwrrrrs> $        "  Kn