Instructions to use JakeOh/LLaDA-8B-Instruct-fixed with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use JakeOh/LLaDA-8B-Instruct-fixed with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="JakeOh/LLaDA-8B-Instruct-fixed", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("JakeOh/LLaDA-8B-Instruct-fixed", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
| {% set loop_messages = messages %} | |
| {%- for message in loop_messages %} | |
| {% set content = '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n' + message['content'] | trim + '<|eot_id|>' %} | |
| {%- if loop.index0 == 0 %} | |
| {% set content = bos_token + content %} | |
| {%- endif %}{{ content }} | |
| {%- endfor %} | |
| {%- if add_generation_prompt %} | |
| {{ '<|start_header_id|>assistant<|end_header_id|>\n\n' }} | |
| {%- endif %} | |