Add to readme

README.md

@@ -22,15 +22,28 @@ Features:
   * Supports Q8, Q4, Q5 model quantization
 
 
-Jlama is built with Java 20 and utilizes the new [Vector API](https://openjdk.org/jeps/448) 
+Jlama is built with Java 20+ and utilizes the new [Vector API](https://openjdk.org/jeps/448) 
 for faster inference.
 
-This project is a work in progress.
-
-## Why?
+## What is it used for?
 
 Add LLM Inference directly to your Java application.
 
+## Demo
+
+Jlama includes a simple UI if you just want to chat with an llm.
+
+```
+./download-hf-model.sh tjake/llama2-7b-chat-hf-jlama-Q4
+./run-cli.sh serve models/llama2-7b-chat-hf-jlama-Q4
+
+```
+open browser to http://localhost:8080/ui/index.html
+
+<p align="center">
+  <img src="docs/demo.png" width="300" height="300" alt="Demo chat">
+</p>
+
 ## How to use
 Jlama includes a cli tool to run models via the `run-cli.sh` command. 
 Before you do that first download one or more models from huggingface.

jlama-cli/pom.xml

@@ -31,6 +31,20 @@
       <groupId>org.jboss.resteasy</groupId>
       <artifactId>resteasy-jackson2-provider</artifactId>
       <version>${resteasy.version}</version>
+      <exclusions>
+        <exclusion>
+          <groupId>com.fasterxml.jackson.core</groupId>
+          <artifactId>jackson-core</artifactId>
+        </exclusion>
+        <exclusion>
+          <groupId>com.fasterxml.jackson.core</groupId>
+          <artifactId>jackson-databind</artifactId>
+        </exclusion>
+        <exclusion>
+          <groupId>com.fasterxml.jackson.core</groupId>
+          <artifactId>jackson-annotations</artifactId>
+        </exclusion>
+      </exclusions>
     </dependency>
     <dependency>
       <groupId>org.jboss.resteasy</groupId>

jlama-cli/src/main/resources/index.html

@@ -36,7 +36,7 @@ <h1>Chat with Jlama</h1>
         </div>
         <div id="scroll-wrapper">
             <div id="chat-container" class="card">
-                <div class="text-end">
+                <div class="text-start">
                     <button id="delete-chat" class="btn btn-danger" type="button">Delete Chat</button>
                     <button id="save-chat" class="btn btn-secondary" type="button" data-bs-toggle="modal" data-bs-target="#nameModal">Save Chat</button>
                 </div>