| This is the first model which converts Qwen2.5-7B's checkpoint to RWKV-7 architecture. | |
| It's trained in one server with 8xA800 for one day which might not be that versatile. It shows an acceptable performance to chat with you fluently. | |
| The shortage is that this base model can't do math and related tasks. I'll add a more balanced data to improve that model's capability later. | |
| Please refer the https://github.com/yynil/RWKVinLLAMA/blob/rwkv_7/tests/test_chat_cli.py about how to use it. | |
| ```python | |
| python tests/test_chat_cli.py --config_file config.yaml --is_hybrid --num_gpus 1 | |
| ``` | |
| You may need to change the configuration yaml to point the path to the checkpoint path you downloaded. | |
| ```bash | |
| enter message:Write an outline of a thrilling sci-fi fiction. | |
| <|im_start|>user | |
| Write an outline of a thrilling sci-fi fiction.<|im_end|> | |
| <|im_start|>assistant | |
| generated 734 tokens | |
| Title: Quantum Echoes | |
| I. Introduction | |
| - Brief overview of the concept of quantum physics and its influence on the story | |
| - Introduce the protagonist, a young physicist named Alex Chen | |
| - Briefly mention the main plot twist: the discovery of a mysterious quantum anomaly | |
| II. Setting | |
| - The story takes place in a futuristic city called Lumina, where advanced technology and quantum technology have advanced far beyond the current state of the art | |
| - The city is built on a floating platform, with skyscrapers reaching towards the clouds | |
| - The city is powered by quantum energy, and the citizens have adapted to a lifestyle that relies heavily on quantum technology | |
| III. The Discovery | |
| - Alex Chen, a brilliant physicist, is working on a top-secret quantum experiment when he stumbles upon a strange anomaly in his research | |
| - The anomaly is a small, unexplained disturbance in the quantum field that seems to be coming from the city's quantum energy source | |
| - Alex is fascinated by the anomaly and decides to investigate further | |
| IV. The Investigation | |
| - Alex teams up with a team of scientists, including a brilliant physicist named Dr. Rajiv Patel and a tech genius named Marcus Lee | |
| - The team sets out to investigate the anomaly and discovers that it is causing strange phenomena throughout the city, including strange weather patterns and time distortions | |
| - They also discover that the anomaly is not just affecting the city but also the surrounding areas, hinting at a larger, more dangerous conspiracy | |
| V. The Chase | |
| - Alex and his team pursue the anomaly to its source, which leads them to a secret government facility on the outskirts of the city | |
| - They discover that the facility is run by a shadowy organization known as the Quantum Collective, which is using the anomaly to further their own agenda | |
| - The team is pursued by the Quantum Collective, who are determined to stop them from revealing their plans | |
| VI. The Twist | |
| - As the team tries to uncover the truth behind the anomaly, they discover that it is connected to a series of unsolved murders in the city | |
| - The victims are all linked to the Quantum Collective in some way, and it becomes clear that the organization is using the anomaly to further its own agenda | |
| - The team realizes that the Quantum Collective is using the anomaly to manipulate the city's population and gain power | |
| VII. The Confrontation | |
| - Alex and the team finally confront the Quantum Collective in the heart of the city, where they discover that the organization has been using the anomaly to create a new form of reality manipulation | |
| - The protagonist must use their knowledge of quantum physics to stop the Collective and prevent the further spread of the anomaly | |
| - In a tense and action-packed finale, Alex and his team manage to defeat the Collective and destroy the anomaly, saving the city from further chaos | |
| VIII. The Aftermath | |
| - The city begins to recover from the chaos caused by the anomaly, with the Quantum Collective's influence greatly diminished | |
| - Alex becomes a hero in the eyes of the public, but he knows that the Quantum Collective's actions have left a lasting impact on the city | |
| - The story ends with the protagonist reflecting on the power of science and the importance of understanding the mysteries of the universe | |
| IX. Themes | |
| - The novel explores the themes of scientific discovery, the dangers of unchecked power, and the consequences of playing with forces beyond one's understanding | |
| - It also touches on the idea of the unknown and the unknown, and how it can both inspire and terrify us | |
| - The story also touches on the idea of responsibility and the importance of using technology for the greater good rather than for personal gain | |
| ``` | |