﻿python : Received 
notification from 
DBMS server: 
<GqlStatusObject 
gql_status='01N51', st
atus_description='warn
: relationship type 
does not exist. The 
relationship type 
`WORKS_IN` does not 
exist in database 
`f6c60fc9`. Verify 
that the spelling is 
correct.', position=<S
ummaryInputPosition 
line=1, column=20, 
offset=19>, raw_classi
fication='UNRECOGNIZED
', classification=<Not
ificationClassificatio
n.UNRECOGNIZED: 
'UNRECOGNIZED'>, raw_s
everity='WARNING', sev
erity=<NotificationSev
erity.WARNING: 
'WARNING'>, diagnostic
_record={'_classificat
ion': 'UNRECOGNIZED', 
'_severity': 
'WARNING', 
'_position': 
{'offset': 19, 
'line': 1, 'column': 
20}, 'OPERATION': '', 
'OPERATION_CODE': 
'0', 
'CURRENT_SCHEMA': 
'/'}> for query: 
"MATCH (st:Staff)-[:WO
RKS_IN]->(s:School) 
WHERE toLower(s.School
_Name) CONTAINS 
'computing' \nRETURN 
DISTINCT 
st.Staff_Name AS 
Lecturer, st.Role AS 
Role"
At line:1 char:1
+ python 
test_comparison.py 
2>&1 | Out-File 
-FilePath 
comparison_result ...
+ ~~~~~~~~~~~~~~~~~~~~
~~~~~~~~~~
    + CategoryInfo    
          : NotSpeci  
  fied: (Received n   
 otifi...t.Role AS    
 Role":String) []    
, RemoteException
    + FullyQualifiedE 
   rrorId : NativeCo  
  mmandError
 
Model           | Query                                    | G-Lat   | Total-Lat  | Status
----------------------------------------------------------------------------------------------------
Llama-3.1-8B    | What are the admission requirements for  | 4.62s | 6.34s | PASS (1 nodes)
Llama-3.1-8B    | Tell me an insight about Computer Scienc | 1.31s | 2.35s | ZERO_NODES (0 nodes)
Llama-3.1-8B    | List all lecturers in the School of Comp | 1.36s | 3.09s | ZERO_NODES (0 nodes)
Llama-3.1-8B    | Where is the nearest cafeteria?          | 1.35s | 2.36s | PASS (1 nodes)
Llama-3.1-405B  | What are the admission requirements for  | FAIL Gen: Client error '400 Ba
Llama-3.1-405B  | Tell me an insight about Computer Scienc | FAIL Gen: Client error '400 Ba
Llama-3.1-405B  | List all lecturers in the School of Comp | FAIL Gen: Client error '400 Ba
Llama-3.1-405B  | Where is the nearest cafeteria?          | FAIL Gen: Client error '400 Ba
