Communication Error - Agilent OpenLAB

[Jagan90]

Hi Everyone,

We are facing communication issues on LC and GC instruments for past 6 months.

Agilent OpenLAB instruments and we are still unable to find the root cause. can some one suggest a solution for this.

Regards,
K. Jagan

[tkubowicz]

Hello

More details please...how can we help you if we don't know what kind of problem you have - "communication issue" is kind of broad term. Isn't it?

Regards

Tomasz Kubowicz

[Jagan90]

Hi,

When users login and run sample sequences on instruments. The sequence suddenly gets aborted and displays communication issue in the instrument log.

Sudden termination of sequence and displays communication error in the log.



We have investigated in the below possible ways.

CPU performance of the AIC server - Was less than 50%
Network fluctuations between instrument and AIC server - Everything was normal.
Only few instruments have this issue on a particular site.
Please find below the completed error log.



69 41e1 58b74022 0
Sequence KARCZEWSKIC.S started 16:41:54 03/01/17
7da 41e2 58b74023 0
Method Loading Method SECIGG493.M 16:41:55 03/01/17
443 41e2 58b74025 0
Method Method started: line# 1 blank run inj# 1 16:41:57 03/01/17
67 41e2 58b74026 0
Method Instrument running a blank run 16:41:58 03/01/17
0 1dab 58b74027 0
G1315C 1 G1315C:DE63056621 - Detector: Prepare 16:41:59 03/01/17
0 1dab 58b74034 0
G1315C 1 G1315C:DE63056621 - Detector: Idle 16:42:12 03/01/17
0 1dab 58b74034 0
G1315C 1 G1315C:DE63056621 - Run 16:42:12 03/01/17
0 1da8 58b744e5 0
G1316A 1 G1316A:DE63063436 - Postrun 17:02:13 03/01/17
67 41e2 58b744e8 0
Method Instrument run completed 17:02:16 03/01/17
67 41e2 58b744eb 0
Method Method completed 17:02:19 03/01/17
0 1daa 58b744eb 0
G1312A 1 Mismatch between configuration and method se> 17:02:19 03/01/17
0 1daa 58b744eb 0
G1312A 1 ttings automatically resolved 17:02:19 03/01/17
7da 41e2 58b744eb 0
Method Loading Method SECGFS.M 17:02:19 03/01/17
443 41e2 58b744ed 0
Method Method started: line# 2 at 1 inj# 1 17:02:21 03/01/17
67 41e2 58b744ee 0
Method Instrument running sample Vial 1 17:02:22 03/01/17
0 1dab 58b744ef 0
G1315C 1 G1315C:DE63056621 - Detector: Prepare 17:02:23 03/01/17
0 1dab 58b744fc 0
G1315C 1 G1315C:DE63056621 - Detector: Idle 17:02:36 03/01/17
0 1dab 58b7452e 0
G1315C 1 G1315C:DE63056621 - Run 17:03:26 03/01/17
67 41e2 58b749e2 0
Method Instrument run completed 17:23:30 03/01/17
67 41e2 58b749e4 0
Method Method completed 17:23:32 03/01/17
7da 41e2 58b749e5 0
Method Loading Method SECIGG493.M 17:23:33 03/01/17
443 41e2 58b749e7 0
Method Method started: line# 3 at 2 inj# 1 17:23:35 03/01/17
67 41e2 58b749e7 0
Method Instrument running sample Vial 2 17:23:35 03/01/17
0 1dab 58b749e8 0
G1315C 1 G1315C:DE63056621 - Detector: Prepare 17:23:36 03/01/17
0 1dab 58b749f5 0
G1315C 1 G1315C:DE63056621 - Detector: Idle 17:23:49 03/01/17
0 1dab 58b74a25 0
G1315C 1 G1315C:DE63056621 - Run 17:24:37 03/01/17
0 1da8 58b74ed6 0
G1316A 1 G1316A:DE63063436 - Postrun 17:44:38 03/01/17
0 1da9 58b74ed6 0
G1329A 1 G1329A:DE64762393 - Postrun 17:44:38 03/01/17
67 41e2 58b74eda 0
Method Instrument run completed 17:44:42 03/01/17
67 41e2 58b74edc 0
Method Method completed 17:44:44 03/01/17
443 41e2 58b74edc 0
Method Method started: line# 4 at 3 inj# 1 17:44:44 03/01/17
67 41e2 58b74edc 0
Method Instrument running sample Vial 3 17:44:44 03/01/17
0 1dab 58b74edd 0
G1315C 1 G1315C:DE63056621 - Detector: Prepare 17:44:45 03/01/17
0 1dab 58b74eea 0
G1315C 1 G1315C:DE63056621 - Detector: Idle 17:44:58 03/01/17
0 1dab 58b74f1b 0
G1315C 1 G1315C:DE63056621 - Run 17:45:47 03/01/17
0 1da8 58b753cb 0
G1316A 1 G1316A:DE63063436 - Postrun 18:05:47 03/01/17
0 1da9 58b753cb 0
G1329A 1 G1329A:DE64762393 - Postrun 18:05:47 03/01/17
67 41e2 58b753cf 0
Method Instrument run completed 18:05:51 03/01/17
67 41e2 58b753d1 0
Method Method completed 18:05:53 03/01/17
443 41e2 58b753d1 0
Method Method started: line# 5 at 4 inj# 1 18:05:53 03/01/17
67 41e2 58b753d1 0
Method Instrument running sample Vial 4 18:05:53 03/01/17
0 1dab 58b753d2 0
G1315C 1 G1315C:DE63056621 - Detector: Prepare 18:05:54 03/01/17
0 1dab 58b753df 0
G1315C 1 G1315C:DE63056621 - Detector: Idle 18:06:07 03/01/17
0 1dab 58b75410 0
G1315C 1 G1315C:DE63056621 - Run 18:06:56 03/01/17
0 1da8 58b758c0 0
G1316A 1 G1316A:DE63063436 - Postrun 18:26:56 03/01/17
67 41e2 58b758c4 0
Method Instrument run completed 18:27:00 03/01/17
67 41e2 58b758c6 0
Method Method completed 18:27:02 03/01/17
443 41e2 58b758c6 0
Method Method started: line# 6 at 5 inj# 1 18:27:02 03/01/17
67 41e2 58b758c7 0
Method Instrument running sample Vial 5 18:27:03 03/01/17
0 1dab 58b758c8 0
G1315C 1 G1315C:DE63056621 - Detector: Prepare 18:27:04 03/01/17
0 1dab 58b758d5 0
G1315C 1 G1315C:DE63056621 - Detector: Idle 18:27:17 03/01/17
0 1dab 58b75906 0
G1315C 1 G1315C:DE63056621 - Run 18:28:06 03/01/17
0 1da8 58b75db6 0
G1316A 1 G1316A:DE63063436 - Postrun 18:48:06 03/01/17
67 41e2 58b75db9 0
Method Instrument run completed 18:48:09 03/01/17
67 41e2 58b75dbc 0
Method Method completed 18:48:12 03/01/17
443 41e2 58b75dbc 0
Method Method started: line# 7 at 6 inj# 1 18:48:12 03/01/17
67 41e2 58b75dbc 0
Method Instrument running sample Vial 6 18:48:12 03/01/17
0 1dab 58b75dbd 0
G1315C 1 G1315C:DE63056621 - Detector: Prepare 18:48:13 03/01/17
0 1dab 58b75dca 0
G1315C 1 G1315C:DE63056621 - Detector: Idle 18:48:26 03/01/17
0 1dab 58b75dfb 0
G1315C 1 G1315C:DE63056621 - Run 18:49:15 03/01/17
0 1da8 58b762ab 0
G1316A 1 G1316A:DE63063436 - Postrun 19:09:15 03/01/17
67 41e2 58b762af 0
Method Instrument run completed 19:09:19 03/01/17
67 41e2 58b762b1 0
Method Method completed 19:09:21 03/01/17
443 41e2 58b762b1 0
Method Method started: line# 8 at 7 inj# 1 19:09:21 03/01/17
67 41e2 58b762b2 0
Method Instrument running sample Vial 7 19:09:22 03/01/17
0 1dab 58b762b2 0
G1315C 1 G1315C:DE63056621 - Detector: Prepare 19:09:22 03/01/17
0 1dab 58b762c0 0
G1315C 1 G1315C:DE63056621 - Detector: Idle 19:09:36 03/01/17
0 1dab 58b762f0 0
G1315C 1 G1315C:DE63056621 - Run 19:10:24 03/01/17
0 1da8 58b767a1 0
G1316A 1 G1316A:DE63063436 - Postrun 19:30:25 03/01/17
0 1da9 58b767a1 0
G1329A 1 G1329A:DE64762393 - Postrun 19:30:25 03/01/17
67 41e2 58b767a4 0
Method Instrument run completed 19:30:28 03/01/17
67 41e2 58b767a6 0
Method Method completed 19:30:30 03/01/17
443 41e2 58b767a6 0
Method Method started: line# 9 at 8 inj# 1 19:30:30 03/01/17
67 41e2 58b767a7 0
Method Instrument running sample Vial 8 19:30:31 03/01/17
0 1dab 58b767a8 0
G1315C 1 G1315C:DE63056621 - Detector: Prepare 19:30:32 03/01/17
0 1dab 58b767b5 0
G1315C 1 G1315C:DE63056621 - Detector: Idle 19:30:45 03/01/17
0 1dab 58b767e6 0
G1315C 1 G1315C:DE63056621 - Run 19:31:34 03/01/17
0 1da8 58b76c96 0
G1316A 1 G1316A:DE63063436 - Postrun 19:51:34 03/01/17
67 41e2 58b76c99 0
Method Instrument run completed 19:51:37 03/01/17
67 41e2 58b76c9b 0
Method Method completed 19:51:39 03/01/17
443 41e2 58b76c9b 0
Method Method started: line# 10 at 9 inj# 1 19:51:39 03/01/17
67 41e2 58b76c9c 0
Method Instrument running sample Vial 9 19:51:40 03/01/17
0 1dab 58b76c9d 0
G1315C 1 G1315C:DE63056621 - Detector: Prepare 19:51:41 03/01/17
0 1dab 58b76caa 0
G1315C 1 G1315C:DE63056621 - Detector: Idle 19:51:54 03/01/17
0 1dab 58b76cdb 0
G1315C 1 G1315C:DE63056621 - Run 19:52:43 03/01/17
0 1da8 58b7718b 0
G1316A 1 G1316A:DE63063436 - Postrun 20:12:43 03/01/17
0 1da9 58b7718c 0
G1329A 1 G1329A:DE64762393 - Postrun 20:12:44 03/01/17
67 41e2 58b7718e 0
Method Instrument run completed 20:12:46 03/01/17
67 41e2 58b77190 0
Method Method completed 20:12:48 03/01/17
443 41e2 58b77191 0
Method Method started: line# 11 at 10 inj# 1 20:12:49 03/01/17
67 41e2 58b77191 0
Method Instrument running sample Vial 10 20:12:49 03/01/17
0 1dab 58b77192 0
G1315C 1 G1315C:DE63056621 - Detector: Prepare 20:12:50 03/01/17
0 1dab 58b7719f 0
G1315C 1 G1315C:DE63056621 - Detector: Idle 20:13:03 03/01/17
0 1dab 58b771d2 0
G1315C 1 G1315C:DE63056621 - Run 20:13:54 03/01/17
67 41e2 58b7752c 0
Method Instrument Error - Method/Sequence stopped 20:28:12 03/01/17
67 41e2 58b7752c 0
Method Method aborted 20:28:12 03/01/17
0 1dab 58b7755c 0
G1315C 1 Communication error. 20:29:00 03/01/17
0 1da8 58b7755c 0
G1316A 1 Communication error. 20:29:00 03/01/17
0 1daa 58b77560 0
G1312A 1 Communication error. 20:29:04 03/01/17
0 1da9 58b77560 0
G1329A 1 Communication error. 20:29:04 03/01/17
0 1da8 58b77565 0
G1316A 1 G1316A:DE63063436 - Thermostat on 20:29:09 03/01/17
67 41e2 58b77566 0
Method Method started 20:29:10 03/01/17
67 41e2 58b77566 0
Method Instrument remote started sample Vial 10 20:29:10 03/01/17
7da 41e2 58b7756c 0
Method Loading Method SECIGG493.M 20:29:16 03/01/17
70 41e6 58b7756f 0
ECM ECM Upload after acquisition 20:29:19 03/01/17
70 41e6 58b7756f 0
ECM Karczewski, Cezary 20:29:19 03/01/17
70 41e6 58b7756f 0
ECM Frederick\QC\LC_QC_M208566\Results 20:29:19 03/01/17
70 41e6 58b7756f 0
ECM LC_QC_M208566 20:29:19 03/01/17
70 41e6 58b7756f 0
ECM ASPRD0272 20:29:19 03/01/17
43e 41e1 58b77572 0
Sequence KARCZEWSKIC.S terminated due to an error 20:29:22 03/01/17
43e 41e1 58b77572 0
Sequence KARCZEWSKIC.S completed 20:29:22 03/01/17


Regards,
K. Jagan

[tkubowicz]

Hello

You've got ECM so first thing I'd do is to bypass network and run few sequences as standalone system : PC - LC (no network ECM).
Then you can narrow it down to network issue (if you'll have no errors without ECM).
I'd also run online connection window (you can do it through CMD window) in background so you can monitor PC-LC connection all the time. If you have some network issue (IT can do it some upgrades in the night) you will see connection lost.

Regards

Tomasz Kubowicz

[Jagan90]

Hi Thomas,

Thank you for your response.

This is Production system and we cannot stop the ECM as many instruments are simultaneously connected to the AIC server

For the below suggestion can you help me get more idea on this.
I'd also run online connection window (you can do it through CMD window) in background so you can monitor PC-LC connection all the time.

Regards,
K. Jagan

[tkubowicz]

Hi

You need to know IP of LAN card in LC (detector) - you can check it in "instrument configuration" in OpenLab

In CMD window type: ping "IP adress" -t

you will see connection status berween PC-LC

Regards

Tomasz Kubowicz

[Jagan90]

Hi Tomasz,


We have tested the IP address of LAN and monitored it several times during the sequence run where we did not find any issues.

Actually almost all teams from site level network, switch ports and everything were monitored and we were unable to find a solution.


This occurs in a set of instruments alone. I can send you all the investigations done to your email ID if you can share.

Even Agilent engineers are unable to find the root cause.

Regards,
K. Jagan

[LabPro]

I have had mysterious corrupted sequences before. I started from scratch to create a new sequence and save it.

[kanzy]

Hi Jagan,

We are experiencing the same problem with OpenLAB server in the past weeks. Have you solved the problem or have any idea about it? Thanks very much for any info.

Best,
Kan

[Consumer Products Guy]

We are facing communication issues on LC and GC instruments for past 6 months.

Agilent OpenLAB instruments and we are still unable to find the root cause. can some one suggest a solution for this.

It's my fault.

Ask my old boss. Whatever went wrong with Open Lab he declared that it was my fault. Interesting, because I'm a computer-idiot, can barely type, and just 3 weeks ago bought my first laptop (refurbished) and moved to Windows 7 from XP.