Update README.md
Browse filesadd readme file details
README.md
CHANGED
@@ -10,3 +10,53 @@ pinned: false
|
|
10 |
---
|
11 |
|
12 |
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
---
|
11 |
|
12 |
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
|
13 |
+
|
14 |
+
# Team 3 Project - Tone Evaluation
|
15 |
+
|
16 |
+
## Overview
|
17 |
+
|
18 |
+
Welcome to Team 3's Tone Evaluation project! This repository contains the necessary files and resources for our project, which focuses on data processing, training, testing, and a user interface (UI) demo.
|
19 |
+
|
20 |
+
## Project Structure
|
21 |
+
|
22 |
+
- **Data Processing File**: [data_processing.py](/path/to/data_processing.py)
|
23 |
+
- This script is responsible for processing the raw data and preparing it for training and testing.
|
24 |
+
- It takes input audio in wav format, and transfer audio into mel spectrum form and fundamental frequency form. These will be the two main features for the model to analyze.
|
25 |
+
- We convert the pinyin and tone into numerical lables by providing a text file and link each pinyin to a index.
|
26 |
+
|
27 |
+
- **Train File**: [train.py](/path/to/train.py)
|
28 |
+
- This file contains the code for training our tone evaluation model. We use CNN+CTC model for this task.
|
29 |
+
|
30 |
+
- **Test File**: [test.py](/path/to/test.py)
|
31 |
+
- Use this script to evaluate the performance of our trained model on test data.
|
32 |
+
- Currenty, we set the model to only accepct wav format audio, and after loading the audio, model will predict the tone sequence for the sentence.
|
33 |
+
|
34 |
+
- **UI Demo**: [ui_demo.py](/path/to/ui_demo.py)
|
35 |
+
- Explore the user interface demo to interact with the tone evaluation model.
|
36 |
+
- You can upload wav format audio to our UI and see the evaluation result. We also provided some audio files for you to directly use.
|
37 |
+
|
38 |
+
## Dataset
|
39 |
+
|
40 |
+
We provide two versions of the dataset:
|
41 |
+
|
42 |
+
- **Full Size Version**: Download from Kaggle [full_dataset](https://huggingface.co/datasets/CS5647Team3/full_dataset)
|
43 |
+
- **Small Size Zip Version**: Zip file, Download from [data_mini](https://huggingface.co/datasets/CS5647Team3/data_mini)
|
44 |
+
|
45 |
+
Additionally, we offer a text file for Pinyin encoding: [pinyin_encoding.txt](/path/to/pinyin_encoding.txt). This file is crucial for understanding the encoding used in our dataset.
|
46 |
+
|
47 |
+
## Getting Started
|
48 |
+
|
49 |
+
Follow these steps to get started with our project:
|
50 |
+
|
51 |
+
1. Clone this repository to your local machine.
|
52 |
+
2. Run the data processing script: `python data_processing.py`
|
53 |
+
3. Train the model using: `python train.py`
|
54 |
+
4. Evaluate the model with: `python test.py`
|
55 |
+
5. Explore the UI demo: `python ui_demo.py`
|
56 |
+
|
57 |
+
## Additional Information
|
58 |
+
|
59 |
+
|
60 |
+
- If you encounter any issues or have questions, feel free to reach out to our team through the [Issues](/path/to/issues) section.
|
61 |
+
|
62 |
+
We hope you find our project useful and insightful! Happy coding!
|