autocomplete
no way to compare when less than two revisions
Differences
This shows you the differences between two versions of the page.
— | autocomplete [2023/08/04 19:00] (current) – created alexander01998 | ||
---|---|---|---|
Line 1: | Line 1: | ||
+ | ====== AutoComplete ====== | ||
+ | <WRAP 516px> | ||
+ | ^ AutoComplete | ||
+ | |{{ hack: | ||
+ | ^Type|Hack| | ||
+ | ^Category|[[: | ||
+ | ^In-game description|" | ||
+ | ^[[: | ||
+ | ^Source code|[[w7src> | ||
+ | |::: | ||
+ | </ | ||
+ | |||
+ | AutoComplete is a Minecraft hack that generates auto-completions for the user's chat messages, using large language models like GPT-3, GPT-4 and LLaMA. | ||
+ | |||
+ | ===== Settings ===== | ||
+ | |||
+ | ==== API provider ==== | ||
+ | ^ API provider | ||
+ | ^Type|Enum| | ||
+ | ^In-game description|" | ||
+ | ^Default value|oobabooga| | ||
+ | ^Possible values|OpenAI, | ||
+ | |||
+ | The "API provider" | ||
+ | |||
+ | ==== OpenAI model ==== | ||
+ | ^ OpenAI model ^^ | ||
+ | ^Type|Enum| | ||
+ | ^In-game description|" | ||
+ | ^Default value|gpt-3.5-turbo| | ||
+ | ^Possible values|gpt-3.5-turbo, | ||
+ | |||
+ | ==== Max tokens ==== | ||
+ | ^ Max tokens | ||
+ | ^Type|Slider| | ||
+ | ^In-game description|" | ||
+ | ^Default value|16 tokens| | ||
+ | ^Minimum|1 token| | ||
+ | ^Maximum|100 tokens| | ||
+ | ^Increment|1 token| | ||
+ | |||
+ | ==== Temperature ==== | ||
+ | ^ Temperature | ||
+ | ^Type|Slider| | ||
+ | ^In-game description|" | ||
+ | ^Default value|0.7| | ||
+ | ^Minimum|0| | ||
+ | ^Maximum|2| | ||
+ | ^Increment|0.01| | ||
+ | |||
+ | Note: Temperature values above 1 will cause most language models to generate complete nonsense and should only be used for comedic effect. | ||
+ | |||
+ | ==== Top P ==== | ||
+ | ^ Top P ^^ | ||
+ | ^Type|Slider| | ||
+ | ^In-game description|" | ||
+ | ^Default value|100%| | ||
+ | ^Minimum|0% | ||
+ | ^Maximum|100%| | ||
+ | ^Increment|1%| | ||
+ | |||
+ | ==== Presence penalty ==== | ||
+ | ^ Presence penalty | ||
+ | ^Type|Slider| | ||
+ | ^In-game description|" | ||
+ | ^Default value|0| | ||
+ | ^Minimum|-2| | ||
+ | ^Maximum|2| | ||
+ | ^Increment|0.01| | ||
+ | |||
+ | ==== Frequency penalty ==== | ||
+ | ^ Frequency penalty | ||
+ | ^Type|Slider| | ||
+ | ^In-game description|" | ||
+ | ^Default value|0.6| | ||
+ | ^Minimum|-2| | ||
+ | ^Maximum|2| | ||
+ | ^Increment|0.01| | ||
+ | |||
+ | ==== Repetition penalty ==== | ||
+ | ^ Repetition penalty | ||
+ | ^Type|Slider| | ||
+ | ^In-game description|" | ||
+ | ^Default value|1| | ||
+ | ^Minimum|1| | ||
+ | ^Maximum|1.5| | ||
+ | ^Increment|0.01| | ||
+ | |||
+ | ==== Encoder repetition penalty ==== | ||
+ | ^ Encoder repetition penalty | ||
+ | ^Type|Slider| | ||
+ | ^In-game description|" | ||
+ | ^Default value|1| | ||
+ | ^Minimum|0.8| | ||
+ | ^Maximum|1.5| | ||
+ | ^Increment|0.01| | ||
+ | |||
+ | ==== Stop sequence ==== | ||
+ | ^ Stop sequence | ||
+ | ^Type|Enum| | ||
+ | ^In-game description|" | ||
+ | ^Default value|Line Break| | ||
+ | ^Possible values|Line Break, Next Message| | ||
+ | |||
+ | Note: " | ||
+ | |||
+ | ==== Context length ==== | ||
+ | ^ Context length | ||
+ | ^Type|Slider| | ||
+ | ^In-game description|" | ||
+ | ^Default value|10 messages| | ||
+ | ^Minimum|0 (unlimited)| | ||
+ | ^Maximum|100 messages| | ||
+ | ^Increment|1 message| | ||
+ | |||
+ | ==== Filter server messages ==== | ||
+ | ^ Filter server messages | ||
+ | ^Type|Checkbox| | ||
+ | ^In-game description|" | ||
+ | ^Default value|not checked| | ||
+ | |||
+ | ==== OpenAI chat endpoint ==== | ||
+ | ^ OpenAI chat endpoint | ||
+ | ^Type|TextField| | ||
+ | ^In-game description|" | ||
+ | ^Default value|'' | ||
+ | |||
+ | The " | ||
+ | |||
+ | It may also be useful for Microsoft Azure customers who have their own endpoint, but this has not been tested yet. There are subtle differences in the Azure version of the API, so it's possible that it won't work with AutoComplete. | ||
+ | |||
+ | ==== OpenAI legacy endpoint ==== | ||
+ | ^ OpenAI legacy endpoint | ||
+ | ^Type|TextField| | ||
+ | ^In-game description|" | ||
+ | ^Default value|'' | ||
+ | |||
+ | The " | ||
+ | |||
+ | It may also be useful for Microsoft Azure customers who have their own endpoint, but this has not been tested yet. There are subtle differences in the Azure version of the API, so it's possible that it won't work with AutoComplete. | ||
+ | |||
+ | ==== Oobabooga endpoint ==== | ||
+ | ^ Oobabooga endpoint | ||
+ | ^Type|TextField| | ||
+ | ^In-game description|" | ||
+ | ^Default value|'' | ||
+ | |||
+ | The " | ||
+ | |||
+ | By running the Oobabooga web UI on a server, rented from a specialized AI hosting provider, it's possible to use much more powerful language models that would not be possible to run on a gaming computer. | ||
+ | |||
+ | ==== Max suggestions per draft ==== | ||
+ | ^ Max suggestions per draft ^^ | ||
+ | ^Type|Slider| | ||
+ | ^In-game description|" | ||
+ | ^Default value|3| | ||
+ | ^Minimum|1| | ||
+ | ^Maximum|10| | ||
+ | ^Increment|1| | ||
+ | |||
+ | The "Max suggestions per draft" setting controls how many different suggestions the AI will try to generate for the same draft message. Higher values will result in more suggestions, | ||
+ | |||
+ | Setting "Max suggestions per draft" to a higher value than "Max suggestions shown" is usually not a good idea, as there will be no way to see the additional suggestions. | ||
+ | |||
+ | ==== Max suggestions kept ==== | ||
+ | ^ Max suggestions kept ^^ | ||
+ | ^Type|Slider| | ||
+ | ^In-game description|" | ||
+ | ^Default value|100 messages| | ||
+ | ^Minimum|10 messages| | ||
+ | ^Maximum|1000 messages| | ||
+ | ^Increment|10 messages| | ||
+ | |||
+ | The "Max suggestions kept" setting only controls at what point old suggestions are deleted from memory. Higher values don't use any additional tokens and only consume a tiny amount of RAM. This is why the range of values is so much higher than for the other settings. | ||
+ | |||
+ | ==== Max suggestions shown ==== | ||
+ | ^ Max suggestions shown ^^ | ||
+ | ^Type|Slider| | ||
+ | ^In-game description|" | ||
+ | ^Default value|5| | ||
+ | ^Minimum|1| | ||
+ | ^Maximum|10| | ||
+ | ^Increment|1| | ||
+ | |||
+ | The "Max suggestions shown" setting controls how many suggestions can be shown at once on the screen. Depending on the user's screen resolution and GUI scale, higher values may cause the suggestions to cover up other parts of the UI. | ||
+ | |||
+ | Setting "Max suggestions per draft" to a higher value than "Max suggestions shown" is usually not a good idea, as there will be no way to see the additional suggestions. | ||
+ | |||
+ | ===== Changes ===== | ||
+ | ^Version^Changes^ | ||
+ | |[[update: | ||
+ | |[[update: | ||
+ | |[[update: | ||
+ | |::: | ||
+ | |||
+ | {{tag> |
autocomplete.txt · Last modified: 2023/08/04 19:00 by alexander01998