Fix (batch-size) after rebase.

srogmann · srogmann · commit 60d6b1e60977 · 2024-11-23T22:31:38.000+01:00
diff --git a/Llama3.java b/Llama3.java
@@ -365,7 +365,7 @@ else if ("user".equals(role)) {
                     }
                     if (httpSession == null) {
                         // We build a new HTTP-session.
-                        final Llama.State state = model.createNewState();
+                        final Llama.State state = model.createNewState(BATCH_SIZE);
                         sessionKey = "SESS-" + reqCounter.get() + "-" + UUID.randomUUID().toString();
                         exchange.getResponseHeaders().add("Set-Cookie", "LLAMA_SESS_ID=" + sessionKey);
 

Original file line number	Diff line number	Diff line change
`@@ -365,7 +365,7 @@ else if ("user".equals(role)) {`
`365`	`365`	`}`
`366`	`366`	`if (httpSession == null) {`
`367`	`367`	`// We build a new HTTP-session.`
`368`		`- final Llama.State state = model.createNewState();`
	`368`	`+ final Llama.State state = model.createNewState(BATCH_SIZE);`
`369`	`369`	`sessionKey = "SESS-" + reqCounter.get() + "-" + UUID.randomUUID().toString();`
`370`	`370`	`exchange.getResponseHeaders().add("Set-Cookie", "LLAMA_SESS_ID=" + sessionKey);`
`371`	`371`