Figure 7
The illustration presents a comparison table evaluating responses from different models for a given query. The layout is divided into two main vertical sections labeled “Question” on the left and “Ground Truth” on the right. Below the “Question”, two model responses, by “K G-Caps G N N-R A G” and “Deep Seek V 3.2”, are shown. Below the “Ground Truth”, two model responses, by “Qwen 3-Max” and “Chat G P T (G P T-5.1)”. In the leftmost column, the question is displayed: “Which aspects are mainly involved in the inspection of elevator brake spring fatigue or fracture?” below the label “Example”. This column provides the prompt used to generate responses. Next, the “Ground Truth” column contains a detailed reference answer, reading, “The inspection of brake springs should include visual inspection, dimensional measurement, performance testing, non destructive testing, and observation of operating conditions. First, strong lighting and a magnifying glass should be used to check whether cracks, corrosion, or obvious deformation are present on the spring surface, since cracks indicate potential fracture risks, corrosion reduces mechanical strength, and deformation suggests changes in the internal structure. Next, the free height of the spring should be measured and compared with the design specifications, as excessive deviation may indicate spring fatigue; meanwhile, specialized equipment should be used to test spring stiffness, and values that do not meet the specified requirements indicate changes in elastic performance and potential fatigue risk. For springs at critical positions, non destructive testing methods such as magnetic particle testing or ultrasonic testing should be applied to detect internal defects. Finally, during elevator operation, the extension and compression behavior of the spring should be observed to assess whether the motion is smooth, and abnormal noise should be monitored; if jamming or unusual noise occurs, potential problems may exist and further inspection is required to ensure reliable operation of the braking system”. In the “K G-Caps G N N-R A G” section, the generated answer is shown in paragraph form, addressing “Key inspection points for elevator brake springs with fatigue or fracture mainly include the following aspects. Visual inspection involves using strong lighting and a magnifying glass to examine whether there are cracks, corrosion, or obvious deformation on the spring surface, where micro cracks may become fracture risks and corrosion can weaken material strength. Dimensional measurement requires measuring the free height under no load conditions and comparing it with the design specifications, while performance testing includes measuring spring stiffness to evaluate changes in elastic performance. Non-destructive testing applies techniques such as magnetic particle testing and ultrasonic testing to detect hidden internal defects. Observation of operating conditions focuses on whether abnormal noise occurs during operation and whether the extension and compression of the spring are smooth”. At the bottom of this section, evaluation metrics are displayed: “Answer Correctness: 0.778” and “Answer Relevancy: 0.798”. In the “Deep Seek V 3.2” section, another generated answer is presented, reading, “The inspection mainly covered the following aspects. Visual inspection focused on observing whether cracks, corrosion, permanent deformation, or fracture traces were present on the spring surface, with particular attention paid to the end coils and contact areas with supports. Dimensional measurement and performance testing involved measuring the free height, compressed height, and stiffness variation to evaluate whether the spring met the design requirements for load and deformation. Non-destructive testing was applied to critical springs using magnetic particle testing or penetrant testing to detect surface and near surface micro cracks. Monitoring of operating conditions examined the opening and closing clearance of the brake and its response time, where abnormalities often indicated degradation in spring performance. Disassembly and in depth analysis were conducted for failed springs, in which fracture analysis, such as scanning electron microscopy, was used to determine the fracture mode, including fatigue, overload, or corrosion. It was recommended to combine inspection results with routine maintenance records, and to conduct focused inspection and preventive replacement for springs that had reached the designed number of load cycles or had experienced abnormal operating conditions”. The evaluation metrics shown are “Answer Correctness: 0.612” and “Answer Relevancy: 0.603”. In the “Qwen 3-Max” section, the response includes “The inspection of elevator brake spring fatigue or fracture mainly included the following aspects: visual inspection, observing whether cracks, deformation, corrosion, wear, or fracture traces were present on the spring; dimensional measurement, checking whether the free height, wire diameter, and other dimensions met the original manufacturer specifications to determine whether permanent deformation had occurred due to fatigue; performance testing, examining whether the compression and recovery of the spring during brake operation were smooth and sufficiently strong, and ensuring that the braking torque met safety requirements; material property evaluation (when necessary), assessing whether material aging or degradation had occurred through hardness testing or metallographic analysis; operation record analysis, evaluating the service life and accumulated fatigue of the spring by combining elevator maintenance records and fault history. The inspection should be conducted in accordance with the Elevator Supervision Inspection and Periodic Inspection Rules and relevant manufacturing standards, and any abnormalities detected should be addressed by timely replacement to prevent braking failure and related safety accidents”. The evaluation metrics shown are “Answer Correctness: 0.669” and “Answer Relevancy: 0.792”. In the “Chat G P T (G P T 5.1)” section, the response includes a structured explanation of inspection aspects, reading “The inspection of elevator brake spring fatigue or fracture mainly included the following aspects: (1) Visual inspection: observing whether the spring exhibited fatigue related features such as cracks, corrosion, deformation, or loosening of end coils. (2) Dimensional measurement and deformation assessment: measuring the free length and working length of the spring to determine whether permanent deformation or abnormal compression had occurred, and comparing the results with manufacturer specifications. (3) Performance testing of elastic force and stiffness: using testing equipment to measure the load displacement characteristics of the spring in order to evaluate whether the elastic force had decreased and whether stiffness had degraded, thereby assessing the degree of fatigue. (4) Non destructive testing: when necessary, applying methods such as magnetic particle testing or penetrant testing to detect micro cracks or hidden damage and to determine potential fracture risks. (5) Installation condition inspection: confirming whether the spring was correctly installed in the brake mechanism and whether eccentric loading or uneven wear was present, so as to prevent stress concentration that could accelerate fatigue. These inspections allowed a comprehensive evaluation of spring performance degradation and enabled timely identification of fatigue damage or potential fracture hazards”. The evaluation metrics shown are “Answer Correctness: 0.597” and “Answer Relevancy: 0.795”.Visualization