This is the first model which converts Qwen2.5-7B's checkpoint to RWKV-7 architecture. It's trained in one server with 8xA800 for one day which might not be that versatile. It shows an acceptable performance to chat with you fluently. The shortage is that this base model can't do math and related tasks. I'll add a more balanced data to improve that model's capability later.
Please refer the https://github.com/yynil/RWKVinLLAMA/blob/rwkv_7/tests/test_chat_cli.py about how to use it.
python tests/test_chat_cli.py --config_file config.yaml --is_hybrid --num_gpus 1
You may need to change the configuration yaml to point the path to the checkpoint path you downloaded.
enter message:Write an outline of a thrilling sci-fi fiction.
<|im_start|>user
Write an outline of a thrilling sci-fi fiction.<|im_end|>
<|im_start|>assistant
generated 734 tokens
Title: Quantum Echoes
I. Introduction
- Brief overview of the concept of quantum physics and its influence on the story
- Introduce the protagonist, a young physicist named Alex Chen
- Briefly mention the main plot twist: the discovery of a mysterious quantum anomaly
II. Setting
- The story takes place in a futuristic city called Lumina, where advanced technology and quantum technology have advanced far beyond the current state of the art
- The city is built on a floating platform, with skyscrapers reaching towards the clouds
- The city is powered by quantum energy, and the citizens have adapted to a lifestyle that relies heavily on quantum technology
III. The Discovery
- Alex Chen, a brilliant physicist, is working on a top-secret quantum experiment when he stumbles upon a strange anomaly in his research
- The anomaly is a small, unexplained disturbance in the quantum field that seems to be coming from the city's quantum energy source
- Alex is fascinated by the anomaly and decides to investigate further
IV. The Investigation
- Alex teams up with a team of scientists, including a brilliant physicist named Dr. Rajiv Patel and a tech genius named Marcus Lee
- The team sets out to investigate the anomaly and discovers that it is causing strange phenomena throughout the city, including strange weather patterns and time distortions
- They also discover that the anomaly is not just affecting the city but also the surrounding areas, hinting at a larger, more dangerous conspiracy
V. The Chase
- Alex and his team pursue the anomaly to its source, which leads them to a secret government facility on the outskirts of the city
- They discover that the facility is run by a shadowy organization known as the Quantum Collective, which is using the anomaly to further their own agenda
- The team is pursued by the Quantum Collective, who are determined to stop them from revealing their plans
VI. The Twist
- As the team tries to uncover the truth behind the anomaly, they discover that it is connected to a series of unsolved murders in the city
- The victims are all linked to the Quantum Collective in some way, and it becomes clear that the organization is using the anomaly to further its own agenda
- The team realizes that the Quantum Collective is using the anomaly to manipulate the city's population and gain power
VII. The Confrontation
- Alex and the team finally confront the Quantum Collective in the heart of the city, where they discover that the organization has been using the anomaly to create a new form of reality manipulation
- The protagonist must use their knowledge of quantum physics to stop the Collective and prevent the further spread of the anomaly
- In a tense and action-packed finale, Alex and his team manage to defeat the Collective and destroy the anomaly, saving the city from further chaos
VIII. The Aftermath
- The city begins to recover from the chaos caused by the anomaly, with the Quantum Collective's influence greatly diminished
- Alex becomes a hero in the eyes of the public, but he knows that the Quantum Collective's actions have left a lasting impact on the city
- The story ends with the protagonist reflecting on the power of science and the importance of understanding the mysteries of the universe
IX. Themes
- The novel explores the themes of scientific discovery, the dangers of unchecked power, and the consequences of playing with forces beyond one's understanding
- It also touches on the idea of the unknown and the unknown, and how it can both inspire and terrify us
- The story also touches on the idea of responsibility and the importance of using technology for the greater good rather than for personal gain