Inheritance diagram for Llama2Device:Public Member Functions | |
| Llama2Device () | |
| Llama2Device (const Llama2Device &)=delete | |
| Llama2Device (Llama2Device &&) noexcept=delete | |
| Llama2Device & | operator= (const Llama2Device &)=delete |
| Llama2Device & | operator= (Llama2Device &&) noexcept=delete |
| ~Llama2Device () override=default | |
| yarp::dev::ReturnValue | setPrompt (const std::string &prompt) override |
| Performs a question. | |
| yarp::dev::ReturnValue | readPrompt (std::string &oPrompt) override |
| Retrieves the provided prompt. | |
| yarp::dev::ReturnValue | ask (const std::string &question, yarp::dev::LLM_Message &oAnswer) override |
| Performs a question. | |
| yarp::dev::ReturnValue | getConversation (std::vector< yarp::dev::LLM_Message > &oConversation) override |
| Retrieves the whole conversation. | |
| yarp::dev::ReturnValue | deleteConversation () noexcept override |
| Delete the conversation and clear the system context from any internally stored context. | |
| yarp::dev::ReturnValue | refreshConversation () noexcept override |
| Refresh the conversation. | |
| yarp::dev::ReturnValue | init_LLM (const std::string &model_path) |
| bool | open (yarp::os::Searchable &config) override |
| Open the DeviceDriver. | |
| bool | close () override |
| Close the DeviceDriver. | |
| void | help () |
| void | convAdd (std::vector< yarp::dev::LLM_Message > &conversation, const std::string &type, const std::string &content) |
Public Member Functions inherited from yarp::dev::DeviceDriver | |
| DeviceDriver () | |
| DeviceDriver (const DeviceDriver &other)=delete | |
| DeviceDriver (DeviceDriver &&other) noexcept=delete | |
| DeviceDriver & | operator= (const DeviceDriver &other)=delete |
| DeviceDriver & | operator= (DeviceDriver &&other) noexcept=delete |
| virtual | ~DeviceDriver () |
| virtual std::string | id () const |
| Return the id assigned to the PolyDriver. | |
| virtual void | setId (const std::string &id) |
| Set the id for this device. | |
| template<class T > | |
| bool | view (T *&x) |
| Get an interface to the device driver. | |
| virtual DeviceDriver * | getImplementation () |
| Some drivers are bureaucrats, pointing at others. | |
Public Member Functions inherited from Llama2Device_ParamsParser | |
| Llama2Device_ParamsParser () | |
| ~Llama2Device_ParamsParser () override=default | |
| bool | parseParams (const yarp::os::Searchable &config) override |
| Parse the DeviceDriver parameters. | |
| std::string | getDeviceClassName () const override |
| Get the name of the DeviceDriver class. | |
| std::string | getDeviceName () const override |
| Get the name of the device (i.e. | |
| std::string | getDocumentationOfDeviceParams () const override |
| Get the documentation of the DeviceDriver's parameters. | |
| std::vector< std::string > | getListOfParams () const override |
| Return a list of all params used by the device. | |
| bool | getParamValue (const std::string ¶mName, std::string ¶mValue) const override |
| Return the value (represented as a string) of the requested parameter. | |
| std::string | getConfiguration () const override |
| Return the configuration of the device. | |
Public Member Functions inherited from yarp::dev::IDeviceDriverParams | |
| virtual | ~IDeviceDriverParams () |
Public Member Functions inherited from yarp::dev::ILLM | |
| virtual | ~ILLM () |
| Destructor. | |
Additional Inherited Members | |
Public Attributes inherited from Llama2Device_ParamsParser | |
| const std::string | m_device_classname = {"Llama2Device"} |
| const std::string | m_device_name = {"yarp_llama2Device"} |
| bool | m_parser_is_strict = false |
| const parser_version_type | m_parser_version = {} |
| std::string | m_provided_configuration |
| const std::string | m_model_context_defaultValue = {""} |
| const std::string | m_model_name_defaultValue = {""} |
| const std::string | m_npredict_defaultValue = {"128"} |
| const std::string | m_ngl_defaultValue = {"50"} |
| const std::string | m_offload_gpu_defaultValue = {"true"} |
| const std::string | m_context_defaultValue = {"4096"} |
| const std::string | m_prompt_file_defaultValue = {""} |
| const std::string | m_prompt_context_defaultValue = {""} |
| std::string | m_model_context = {} |
| std::string | m_model_name = {} |
| int | m_npredict = {128} |
| int | m_ngl = {50} |
| bool | m_offload_gpu = {true} |
| int | m_context = {4096} |
| std::string | m_prompt_file = {} |
| std::string | m_prompt_context = {} |
Definition at line 32 of file Llama2Device.h.
| Llama2Device::Llama2Device | ( | ) |
Definition at line 31 of file Llama2Device.cpp.
|
delete |
|
deletenoexcept |
|
overridedefault |
|
overridevirtual |
Performs a question.
| question | the text of the question provided by the user |
| answer | the returned answer |
Implements yarp::dev::ILLM.
Definition at line 91 of file Llama2Device.cpp.
|
overridevirtual |
Close the DeviceDriver.
Reimplemented from yarp::dev::DeviceDriver.
Definition at line 217 of file Llama2Device.cpp.
| void Llama2Device::convAdd | ( | std::vector< yarp::dev::LLM_Message > & | conversation, |
| const std::string & | type, | ||
| const std::string & | content | ||
| ) |
|
overridevirtualnoexcept |
Delete the conversation and clear the system context from any internally stored context.
Implements yarp::dev::ILLM.
Definition at line 196 of file Llama2Device.cpp.
|
overridevirtual |
Retrieves the whole conversation.
| conversation | the conversation |
Implements yarp::dev::ILLM.
Definition at line 175 of file Llama2Device.cpp.
| void Llama2Device::help | ( | ) |
Definition at line 223 of file Llama2Device.cpp.
| yarp::dev::ReturnValue Llama2Device::init_LLM | ( | const std::string & | model_path | ) |
Definition at line 83 of file Llama2Device.cpp.
|
overridevirtual |
Open the DeviceDriver.
| config | is a list of parameters for the device. Which parameters are effective for your device can vary. If there is no example for your device, you can run the "yarpdev" program with the verbose flag set to probe what parameters the device is checking. If that fails too, you'll need to read the source code (please nag one of the yarp developers to add documentation for your device). |
Reimplemented from yarp::dev::DeviceDriver.
Definition at line 36 of file Llama2Device.cpp.
|
delete |
|
deletenoexcept |
|
overridevirtual |
Retrieves the provided prompt.
| prompt | the stored prompt |
Implements yarp::dev::ILLM.
Definition at line 161 of file Llama2Device.cpp.
|
overridevirtualnoexcept |
Refresh the conversation.
Implements yarp::dev::ILLM.
Definition at line 212 of file Llama2Device.cpp.
|
overridevirtual |
Performs a question.
| prompt | provides a prompt to the LLM |
Implements yarp::dev::ILLM.
Definition at line 137 of file Llama2Device.cpp.