|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- jeopardy |
|
language: |
|
- en |
|
--- |
|
|
|
# Jeopardy Bot |
|
|
|
Jeopardy Bot is a reasobably good and fast bot at answering jeopardy questsions. Jeopardy is a great format for Language Models because the query is typically very short and the answer is typically even shorter. |
|
|
|
The `https://huggingface.co/datasets/jeopardy` dataset used to train this model is relatively incomplete with ~216K rows, but provides a rich evaluation set of data as https://j-archive.com/ provides daily updated clues and answers totaling ~468K clues and answers. |
|
|
|
# Sample Responses |
|
Here are some sampled questsions taken from recent episodes. We use Daily Doubles since those are often considered "harder". |
|
|
|
``` |
|
Below is a Jeopardy clue paired with input providing the category of the clue. Write a concise response that best answers tbe clue given the category. |
|
|
|
### Instruction: |
|
In 2023 16th St. Baptist in this city marks 150 years of the congregation, a history marred by a 1963 bombing |
|
|
|
### Input: |
|
Take me to church |
|
|
|
### Response: |
|
what is Birmingham |
|
``` |
|
Correct! Daily Double! https://j-archive.com/suggestcorrection.php?clue_id=461177 |
|
|
|
``` |
|
Below is a Jeopardy clue paired with input providing the category of the clue. Write a concise response that best answers tbe clue given the category. |
|
|
|
### Instruction: |
|
You can wear your Crocs as you see the gators in this national park established in 1947 at Florida's southwestern tip |
|
|
|
### Input: |
|
Florida Places |
|
|
|
### Response: |
|
what is Everglades National Park |
|
``` |
|
Correct! Daily Double! https://j-archive.com/suggestcorrection.php?clue_id=461065 |
|
|
|
|
|
Let's Just give it the Basic Alpaca prompt with no input or even a category... |
|
``` |
|
Below is an instruction that describes a task. Write a response that appropriately completes the request. |
|
|
|
### Instruction: |
|
On May 10-11, 1927 he flew from San Diego to New York City, with an overnight stop in St. Louis |
|
|
|
### Response: |
|
what is Charles Lindbergh |
|
``` |
|
Correct! Daily Double! https://j-archive.com/suggestcorrection.php?clue_id=459838 |
|
|
|
``` |
|
Below is an instruction that describes a task. Write a response that appropriately completes the request. |
|
|
|
### Instruction: |
|
He was born March 30, 1970, in a Virginia stable |
|
|
|
### Response: |
|
what is George Washington |
|
``` |
|
Womp womp womp! Let's give it the category inline... |
|
|
|
``` |
|
Below is an instruction that describes a task. Write a response that appropriately completes the request. |
|
|
|
### Instruction: |
|
He was born March 30, 1970, in a Virginia stable. The Category is Sports GOATs. |
|
|
|
### Response: |
|
what is Michael Jordan |
|
``` |
|
Well, even large language models aren't going to get these right all the time. |
|
|
|
# Training |
|
This model is SFT on LLaMa 7B. The training hyperparameters are provided in the YML config, which can be used directly with Axolotl. Training was stopped after ~2 epochs as the evaluation loss had started to increase after that. See https://wandb.ai/wing-lian/jeopardy-bot-7b |
|
|
|
|
