+- Rigorous and Reliable (RAR) (http://rar.shufangkeji.com:60380)
+-- Forum: 大计算 (/forumdisplay.php?fid=257)
+--- Forum: 应用 (/forumdisplay.php?fid=363)
+---- Forum: BIBO (/forumdisplay.php?fid=602)
+---- Thread: BIBO on wp289b (/showthread.php?tid=9627)
BIBO on wp289b - zhihao - 08-09-2021 06:24 PM
There is a BIBO system on wp289b
We can access wp289b with
p1. login JumpServer with "143.64.64.169/assets/user-asset/"
p2. click "Default - 政务云X86 - 擎盾 - 案例查询系统{01..06}"
We can access website of "强制检索系统" with "143.64.64.145/a/force", query cases by clicking "案例上传"
We can transfer files to dir "/tmp" of wp289b by
p1. access ftp website with "143.64.64.169/koko/elfinder/sftp"
p2. drag files from Win7 to "政务云X86 - 擎盾 - 案例查询系统{01..06}"
RE: BIBO on wp289b - lingu - 08-16-2021 10:47 AM
We need update a few modules and test the delete func.
Pls update utilib first. Build from the latest CT.
RE: BIBO on wp289b - zhihao - 08-16-2021 01:16 PM
install latest utilib on wp289b-{1-6} and restart bibo on wp289b-1, restart sage on wp289b-6, web search system still works
RE: BIBO on wp289b - zhihao - 08-18-2021 04:18 PM
suggest try installing think on wp289b-2 first, because think_portal is wp289b-6, helper_portal is wp289b-1
Code:
[zhihao@gm292-1 wp289b]$ git pull
Already up-to-date.
[zhihao@gm292-1 wp289b]$ grep -ni "portal" nodes.pcf
52:#think_portal: 143.64.64.180
53:think_portal: 143.64.66.176
54:helper_portal: 143.64.64.145
55:#helper_portal: 143.64.66.189
58:sage_portal: 143.64.66.176
[zhihao@gm292-1 wp289b]$ egrep -ni "(portal|think)" nodes.pcf
6:# node_ipx: /thinker/etc/think.ips
46:# tnfs_data_dir: /thinker/storage
51:# think_nords: 1,2,3,4,5,6
52:#think_portal: 143.64.64.180
53:think_portal: 143.64.66.176
54:helper_portal: 143.64.64.145
55:#helper_portal: 143.64.66.189
56:think_user: sage
57:think_base: /home/sage/think
58:sage_portal: 143.64.66.176
[zhihao@gm292-1 wp289b]$RR lingu
RE: BIBO on wp289b - lingu - 08-18-2021 04:23 PM
(08-18-2021 04:18 PM)zhihao Wrote: suggest try installing think on wp289b-2 first, because think_portal is wp289b-6, helper_portal is wp289b-1
Code:
[zhihao@gm292-1 wp289b]$ git pull
Already up-to-date.
[zhihao@gm292-1 wp289b]$ grep -ni "portal" nodes.pcf
52:#think_portal: 143.64.64.180
53:think_portal: 143.64.66.176
54:helper_portal: 143.64.64.145
55:#helper_portal: 143.64.66.189
58:sage_portal: 143.64.66.176
[zhihao@gm292-1 wp289b]$ egrep -ni "(portal|think)" nodes.pcf
6:# node_ipx: /thinker/etc/think.ips
46:# tnfs_data_dir: /thinker/storage
51:# think_nords: 1,2,3,4,5,6
52:#think_portal: 143.64.64.180
53:think_portal: 143.64.66.176
54:helper_portal: 143.64.64.145
55:#helper_portal: 143.64.66.189
56:think_user: sage
57:think_base: /home/sage/think
58:sage_portal: 143.64.66.176
[zhihao@gm292-1 wp289b]$
RR lingu
OK
RE: BIBO on wp289b - zhihao - 08-18-2021 05:01 PM
updated utilib of commit 91b1ce9bf015eab671fa9225e37eed50cf737cd1 on wp289b cluster
RE: BIBO on wp289b - zhihao - 08-18-2021 07:07 PM
install think on helper_portal which is wp289b-1, query doesn't work
check atpa.log-90, query fails at KissFromSage
Code:
2021.08.18 17:41:12 (48): atpd::KissFromSage: k i len, st_size: 90 0
2021.08.18 17:41:12 (48): atpd::KissFromSage: Get ret : 90 32768
2021.08.18 17:41:12 (48): ERROR - KissFromSage: Get failed: 90 0
2021.08.18 17:41:12 (48): atpa.runx kissed back - 8000 0 0 5a
2021.08.18 18:9:37 (67): atpa.runx is to run ..- /bin/sh /thinker/globe/.think/run/atpa.sh 56 90.. 0x38 0x5a 0x0
2021.08.18 18:9:37 (67): atpa.runx creating ..- /thinker/fastdata/bibo/e/res2//56.. 0x38 0x5a 0x0
2021.08.18 18:9:37 (67): atpa.runx creating ..- /thinker/fastdata/bibo/e/res2//56/90.. 0x38 0x5a 0x0
2021.08.18 18:9:37 (67): atpa::runx() kissing : 90
2021.08.18 18:9:37 (67): atpd::KissFromSage: k i len, st_size: 90 0
2021.08.18 18:9:37 (67): atpd::KissFromSage: Get ret : 90 32768
2021.08.18 18:9:37 (67): ERROR - KissFromSage: Get failed: 90 0
2021.08.18 18:9:37 (67): atpa.runx kissed back - 8000 0 0 5aRE: BIBO on wp289b - lingu - 08-18-2021 07:31 PM
(08-18-2021 07:07 PM)zhihao Wrote: install think on helper_portal which is wp289b-1, query doesn't work
check atpa.log-90, query fails at KissFromSage
Code:
2021.08.18 17:41:12 (48): atpd::KissFromSage: k i len, st_size: 90 0
2021.08.18 17:41:12 (48): atpd::KissFromSage: Get ret : 90 32768
2021.08.18 17:41:12 (48): ERROR - KissFromSage: Get failed: 90 0
2021.08.18 17:41:12 (48): atpa.runx kissed back - 8000 0 0 5a
2021.08.18 18:9:37 (67): atpa.runx is to run ..- /bin/sh /thinker/globe/.think/run/atpa.sh 56 90.. 0x38 0x5a 0x0
2021.08.18 18:9:37 (67): atpa.runx creating ..- /thinker/fastdata/bibo/e/res2//56.. 0x38 0x5a 0x0
2021.08.18 18:9:37 (67): atpa.runx creating ..- /thinker/fastdata/bibo/e/res2//56/90.. 0x38 0x5a 0x0
2021.08.18 18:9:37 (67): atpa::runx() kissing : 90
2021.08.18 18:9:37 (67): atpd::KissFromSage: k i len, st_size: 90 0
2021.08.18 18:9:37 (67): atpd::KissFromSage: Get ret : 90 32768
2021.08.18 18:9:37 (67): ERROR - KissFromSage: Get failed: 90 0
2021.08.18 18:9:37 (67): atpa.runx kissed back - 8000 0 0 5a
Need update Sage. Pls update sage on sage_helper
RE: BIBO on wp289b - zhihao - 08-18-2021 08:27 PM
install sage of commit d334b7b4c5f32a2c3eb02a7fc62d4c46312e5283 on sage_helper(wp289b-1) successfully, but query fails
RE: BIBO on wp289b - lingu - 08-18-2021 08:31 PM
(08-18-2021 08:27 PM)zhihao Wrote: install sage on sage_helper(wp289b-1) successfully
better specify the commit id so that we know what version you installed.
RE: BIBO on wp289b - zhihao - 08-18-2021 08:37 PM
(08-18-2021 08:31 PM)lingu Wrote:(08-18-2021 08:27 PM)zhihao Wrote: install sage on sage_helper(wp289b-1) successfully
better specify the commit id so that we know what version you installed.
ok, added the commit id
RE: BIBO on wp289b - zhihao - 08-18-2021 10:21 PM
run "auntie list" on sage_helper and get log. The origin log is 91MB, so I only copy the last few lines.
RE: BIBO on wp289b - zhihao - 08-18-2021 11:07 PM
install think on wp289b-6, failed on test
Code:
[**Test basic mechanisms]
[Wed Aug 18 21:40:05 CST 2021] null.sh => null.c PASSED
[Wed Aug 18 21:40:10 CST 2021] newr.sh => newr.c PASSED
[Wed Aug 18 21:40:14 CST 2021] strlen.sh => strlen.c PASSED
[Wed Aug 18 21:40:18 CST 2021] strnlen.sh => strnlen.c
PASSED
[Wed Aug 18 21:40:22 CST 2021] asm.sh => asm.c PASSED
[Wed Aug 18 21:40:26 CST 2021] bmsg.sh => sum-multiple-languages FAIL
Time used: 0:20.45
make: *** [test] Error 1
Connection to 143.64.66.176 closed.
make: *** [test] Error 2
/thinker/globe/udata/root/Limbo/Packages/wp289b/think.tar.gz failed with exit status 2
(END)install sage on wp289b-6, failed on test
Code:
====== configure is done ====== [0818-21:52:49]
lockstep mark /thinker/globe/.think/lockstep//wp289b-6/sage
lockstep wait wp289b-6/sage
Check whether wp289b-6/sage is ready...
wp289b-6/sage is not yet ready. Wait for a while and check again...(Wed Aug 18 21:52:49 CST 2021)
install completed for sage
set -o errexit
if [[ "True" == "True" ]]; then
ssh sage@143.64.66.176 "cd ~/sage; make test"
else
echo "I am not sage_portal (143.64.66.176). Skip testing."
fi
lockstep mark "$(hostname)/sage/tested"
lockstep mark "$(hostname)/sage/decent/workdone"
make -C correctness test
make[1]: Entering directory `/home/sage/sage/correctness'
=== Begin Sage Service Test Set ===
./sage_service/sage-service-start.sh
timeout: failed to run command ‘/bin/sage’: No such file or directory
make[1]: Leaving directory `/home/sage/sage/correctness'
make[1]: *** [sage-tests] Error 127
make: *** [test] Error 2
make: *** [test] Error 2
/thinker/globe/udata/root/Limbo/Packages/wp289b/sage.tar.gz failed with exit status 2
(END)I insert a case, and query fails.
try list cases, it is
Code:
dep.grid letter 792forget update bibo on all nodes, updated now and make bibo-ext.pcf contain only one line "bibo_doc_cnt: 0"
RE: BIBO on wp289b - zhihao - 08-19-2021 02:53 PM
戚经理早上提到相较于删除功能，搜索时间缩短更为重要一些，删除功能平时他们不怎么用，而搜索时间13秒左右不够快。
RE: BIBO on wp289b - lingu - 08-20-2021 12:02 AM
(08-19-2021 02:53 PM)zhihao Wrote: 戚经理早上提到相较于删除功能，搜索时间缩短更为重要一些，删除功能平时他们不怎么用，而搜索时间13秒左右不够快。
Yes that's one important thing to improve. Pls add a todo.
Another important thing is concurrent query support.
RE: BIBO on wp289b - lingu - 07-17-2022 03:52 PM
20220717/lingu visits tiejian and find wp289b bibo down. think test fails on null and think reports that it could not contact containers.
i find the iptables rules on wp289b-6 drop all incoming packets except for a few ports. but all 6 wp289b nodes are added to be "ACCEPT" nodes.
i find the routing table uses 143.64.66.254 as the default router on wp289b-6, and packets go from wp289b-6 to 143.64.66.254 then 143.64.64.254 then wp289b-1 (143.64.64.145).
so the forwarding rule may be a factor in this setting.
however, even wp289b-5 (143.64.66.190) cannot tcp to wp289b-6:30480 with iptables service running on wp289b-6. Without the iptables service, the tcp to wp289b-6:30480 is fine.
In /etc/sysconfig/iptables on wp289b-6, there is a line '-A INPUT -j REJECT --reject-with-icmp-host-prohibited' before the ACCEPT rules for the wp289b IPs. iptables-save does not show this line on wp289b-1 or wp289b-3, but wp289b-5 has it. I move the line to the end of the filter block. now tcp from wp289b-5 to wp289b-6 is successful.
i went through all iptables files and restarted all iptables services on 6 nodes.
then think test works.
RE: BIBO on wp289b - zhihao - 07-18-2022 12:41 PM
(08-20-2021 12:02 AM)lingu Wrote:(08-19-2021 02:53 PM)zhihao Wrote: 戚经理早上提到相较于删除功能，搜索时间缩短更为重要一些，删除功能平时他们不怎么用，而搜索时间13秒左右不够快。
Yes that's one important thing to improve. Pls add a todo.
Another important thing is concurrent query support.
ok, add two TODOs to D info http://rar.shufangkeji.com:60380/showthread.php?tid=9162