Text Generation
PEFT
Safetensors
GGUF
English
materialsanalyst-ai-7b
MaterialsAnalyst-AI-7B
materials-science
computational-materials
materials-analysis
chain-of-thought
reasoning-model
property-prediction
materials-discovery
crystal-structure
materials-informatics
scientific-ai
7b
quantized
fine-tuned
lora
json-mode
structured-output
materials-engineering
band-gap-prediction
computational-chemistry
materials-characterization
Instructions to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M # Run inference directly in the terminal: llama cli -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M # Run inference directly in the terminal: llama cli -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
Use Docker
docker model run hf.co/Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Raymond-dev-546730/MaterialsAnalyst-AI-7B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Raymond-dev-546730/MaterialsAnalyst-AI-7B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
- Ollama
How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with Ollama:
ollama run hf.co/Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with Docker Model Runner:
docker model run hf.co/Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
- Lemonade
How to use Raymond-dev-546730/MaterialsAnalyst-AI-7B with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Raymond-dev-546730/MaterialsAnalyst-AI-7B:Q4_K_M
Run and chat with the model
lemonade run user.MaterialsAnalyst-AI-7B-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Update README.md
Browse files
README.md
CHANGED
|
@@ -85,9 +85,7 @@ Considering all these properties together, this material would be particularly v
|
|
| 85 |
# Getting Started
|
| 86 |
|
| 87 |
## Installation
|
| 88 |
-
|
| 89 |
Choose your deployment method and install the required dependencies:
|
| 90 |
-
|
| 91 |
```bash
|
| 92 |
# For SafeTensors
|
| 93 |
pip install torch transformers accelerate safetensors
|
|
@@ -95,8 +93,13 @@ pip install torch transformers accelerate safetensors
|
|
| 95 |
pip install llama-cpp-python
|
| 96 |
```
|
| 97 |
|
| 98 |
-
##
|
|
|
|
|
|
|
|
|
|
| 99 |
|
|
|
|
|
|
|
| 100 |
```bash
|
| 101 |
# For SafeTensors
|
| 102 |
python Inference_safetensors.py
|
|
@@ -104,14 +107,7 @@ python Inference_safetensors.py
|
|
| 104 |
python Inference_llama.cpp.py
|
| 105 |
```
|
| 106 |
|
| 107 |
-
## Configuration
|
| 108 |
-
|
| 109 |
-
**Customize your analysis by editing the script:**
|
| 110 |
-
|
| 111 |
-
- **Input data**: Edit the `JSON_INPUT` variable with your materials data
|
| 112 |
-
- **Model location**: Modify the `model_path` variable to point to your model files
|
| 113 |
|
| 114 |
-
**Data sources**: Materials Project, AFLOW, DFT calculations, experimental databases
|
| 115 |
|
| 116 |
## Repository Contents
|
| 117 |
|
|
|
|
| 85 |
# Getting Started
|
| 86 |
|
| 87 |
## Installation
|
|
|
|
| 88 |
Choose your deployment method and install the required dependencies:
|
|
|
|
| 89 |
```bash
|
| 90 |
# For SafeTensors
|
| 91 |
pip install torch transformers accelerate safetensors
|
|
|
|
| 93 |
pip install llama-cpp-python
|
| 94 |
```
|
| 95 |
|
| 96 |
+
## Configuration
|
| 97 |
+
Edit your chosen inference script to customize the analysis:
|
| 98 |
+
- **Input data**: Update the `JSON_INPUT` variable with your materials data
|
| 99 |
+
- **Model location**: Set the `model_path` variable to your downloaded model directory
|
| 100 |
|
| 101 |
+
## Running Analysis
|
| 102 |
+
Run your script and the analysis results will appear in the terminal:
|
| 103 |
```bash
|
| 104 |
# For SafeTensors
|
| 105 |
python Inference_safetensors.py
|
|
|
|
| 107 |
python Inference_llama.cpp.py
|
| 108 |
```
|
| 109 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 110 |
|
|
|
|
| 111 |
|
| 112 |
## Repository Contents
|
| 113 |
|