2
0
mirror of https://github.com/xcat2/xcat-core.git synced 2025-10-10 01:18:10 +00:00
Commit Graph

201 Commits

Author SHA1 Message Date
Bin Xu
eea661e405 merge from master to 2.13 branch for 2.13.9 release. (1) (#4525)
* fix issueNode range not specified, see man page for syntax. return with no output when site.master is not set #4299

* Fix issue 4246, record rflash process in log file

* dodiscovery: better disksize - ordered by major,minor and no `\n` (#4219)

* better disksize: ordered by major,minor and no `\n`

* nodediscover:`disksize` sent correctly: no need to `split`,`join`

* general sort with explicit key columns, fix search pattern

* dodiscovery: Fix bugs

* dodiscovery: Fix ShellCheck SC2007,SC2004

* dodiscovery: simpler kcmdline parsing, disksize as IEC binary prefix

* Add test case - switch_to_dns_forward_mode

* Modify timeout of login by curl command for OpenBMC

* Add makegocons command

This patch enable goconserver service and manage the node sessions
with a new `makegocons` command.

Implement: #4215

* Refine the Cumulus Linux Section of the Doc (#4249)

* No content in the switches subdirectory in docs, remove

* Change the Network topic to Networking

* Refine and reformat the Cumulus Linux documentation

* Modify the script to build xCAT-genesis-base package (#4292)

* Verify hash ID

* change log messages

* Timeout the ntpd process if ntpd service is not running on ntpserver (#4321)

* enhance nodediscovery process: don't write "NOIP" if the node can not be resloved to an IP (#3995)

* enhance nodediscovery process, if only 1 mac and have \*NOIP\* append, don't write mac table and don't generate dhcp lease entry

* Enhance PR 3995: enhance nodediscovery process: don't write "NOIP" if the node can not be resloved to an IP

* modified depending on comments

* natural_sort_cmp: recursion to iterative implementation (#4314)

* natural_sort_cmp: recursion to iterative implementation

* natural_sort_cmp: correct prototype with parameters, as per `man perlfunc`

* Task 3339, rspconfig ip/netmask/gateway/vlan support

*   * Minor enhance on xcatperftest to put all logs into one file
  * Fix a bug in simulatorctl.sh, and it cause the script cannot be found

* modified depending on comments

* QA list for makehosts (#4284)

* QA list for makehosts

* Fix some bus in makegocons

* Revise test case - switch_to_dns_forward_mode

* Enhancements after the review

* Use IO::Socket to check BMC console port

* Revise test case - switch_to_dns_forward_mode

* modified depending on comments

* Add messages to inform the user of the general action started via xCAT for flashing firmware

* Fix bug, anything in the functional array is the one that's really active, priority will not be 0 if there is pending firmware

* Fix 4338, remove all of  in child process

* fix issue #4354 :The XCATTEST_CN in xcattest can not detect HCP as config file (#4355)

* Fix #4330, close the socket

* Add image name to /opt/xcat/xcatinfo on compute node (#4359)

* Integrate congo console from goconserver with rcons

Enhance the original implement of rcons to support goconserver.
`rcons` will help the user choose from one of the console backend
service based on the console server status of management node.

Implement #4216

* Fix 4363 - discovery broken (#4364)

* do not set exit_code to 1 when the clock is not synced before the timeout (#4362)

* Fix check for MTM values with spaces

* modified depending on comments

* rspconfig admin_password for OpenBMC

* Fix merging in xdcpmerge.sh (#4328)

* Fixes in xdcpmerge.sh

Two fixes:
1. The grep pattern when finding duplicate usernames is missing ":" at the end. So, for example user "test" would also match "test2, etc.". Adding the ":" delimiter fixes the issue.
2. Another issue happens when the file to be merged is a superset of the files on the nodes. For example, if a new user is added and entire passwd file (that is otherwise identical) is sent to be merged. In this case, the $filebackup.nodups file, i.e. the original file with duplicates removed, becomes empty and the condition "if [ -s "$filebackup.nodups" ]" does not execute. Then the merged file ends up being original file with the merge file fully appended, clearly not what was intended.

This is solved by changing the condition to check for file existence "-a" rather then for size. Additionally, I also turn the logic around so that the duplicates are removed from the merge file and then added to the original file. I think this makes logic a bit cleaner and also ensures that existing entries are not reordered or changed in any way.

* Streamlining previous commit

Adjustment to previous commit, streamlining and simplifying logic. Once $mergefile.nodups is created, just concatenate it the original file.

* Update to xdcpmerge

No need to copy $filebackup to $curfile, they are the same.

* Modify for debug conveniently

* add new cases and delete outdated test cases

* Modify genesis build script for centos x86_64

* Add space between at and the time

* Add a print out of the firmware levels for the various UT cases

* Add unit test cases for rspconfig

* rspconfig fix for set hostname

* Enhance the testing case for rspconfig setting hostname

* modified depending on comments

* modified depending on comments

* Add %pretrans script in <lua>. Handle directory to symlink change properly. See comment #3 of https://bugs.launchpad.net/rpm/+bug/633636

* Make xCAT-genesis-base confliects with early version of xCAT-genesis-scripts

* rspconfig dump to allow admins capture logs

* Adding comment

* Improve the error message when BMC does not return a dump ID

* Improve some messages and add timestamp for downloaded dump file

* Improve the message to help Admin figure out where the file is missing

* Leave a log file there when xCAT upgrade in case to debug issue while upgrading (#4389)

* Listen on 0.0.0.0 instead of the hostname

This patch modify the configuration of `makegocons` and `rcons`
for goconserver.

`cat /etc/goconserver/server.conf`
```
global:
  host: 0.0.0.0
  ssl_key_file: /etc/xcat/cert/server-key.pem
  ssl_cert_file: /etc/xcat/cert/server-cert.pem
  ssl_ca_cert_file: /etc/xcat/cert/ca.pem
  logfile: /var/log/goconserver/server.log
api:
  port: 12429
console:
  port: 12430
```

* Support hostname=* for openbmc

* Relay action and snmp configuration support for Coral PDU

* ddns.pm: specify the "directory" option for DNS slaves too (cf. bug #4392)

* Fix issue 4361, modify some sendmsg to message

* 1. add "makeconserver -d" to "rmdef -C", 2. add "makeconserver -C|--cleanup" to remove entries for removed nodes

* When there is a problem with the login, do not hide the message on debug mode. BMCReady does not make sense if the admin does not know how to find that state

* Change function from login_logout_request to login_request, not doing any logout here

* Check that RC is 200 to prevent unknown issues, handle the response generically

* OpenBMC rspconfig dump timeout fixes

* Fix issue 4408, modify error for rspconfig dump

* Clear all BMC Dump logs when BMC firmware flash

* modified depending on comments

* More modifications for pr 4386, to deal with the conflicts

* To handle one case which have 2 implementations, which one is for specific platform, on is for all platforms

* return when current status is RSPCONFIG_DUMP_DOWNLOAD_REQUEST

* fix issue 4417, delete 'clear next_status'

* fix issue 4353: rspconfig needs to support multiple IPs on the BMC and ignore ZeroConfigIPs

* Wait 15 seconds after OpenBMC interface with vlan tag to be activated

* Fix issue #4397: rspconfig <> hostname=xxx show error message when there is multiple network in bmc

* Some sentence modify for makeconservercf -C|--cleanup

* OpenBMC rspconfig dump better dump file name formatting

* Removed the --check and --ipsource option with PR 4258, update the man page

* Improve the message on the HTTP response

* modified depending on comments

* Only handle 404 and 504 in the login request code, defer the rest to deal_with_response()

* rflash stream support

* 1. configure ip/netmask/gateway only on the NIC whose IP match node BMC attribute, 2. add some information for LinkLocal address

* Fix confignetwork bond nic_type detection with multiple bonds

* Modified configonie --ntp command (#4436)

* Add man page for makegocons

This is the guide about how to make goconserver as
a replacement for conserver to help slove the issues reported
for conserver, like: #4043, #3543. For openbmc, the solution of
goconserver is much light-weighted than the conserver which could
help save the system resource. In addition, sshpass is not needed
for openbmc with goconserver.

Implement: #4337

* Add another key for node_info in order not to after the content of $node_info{$node}{bmc}

* enhance rflash stream

* makedhcp does not work well when all service nodes not running dhcp but disjointdhcps=1 (#4426) (#4440)

- if all service nodes not running dhcp, to treat it as disjointdhcps=0
- nodeset will send request to MN by default even if disjointdhcps=1
- Move out of the dhcp service checking from opts pre-check, and do it just before real makedhcp handling.

* rspconfig configure bmc vlan will hung because of PR 4383

* OpenBMC rspconfig dump enhancements

* Changes due to review comments

* Print debug message before login attempt

* Add warning when xCAT throttles SSL connections

* Display first [openbmc_debug] when entering openbmc.pm

* modified error msg

* Make sure credential files have a trailing newline (#4442)

* modified depending on comments

* Fix the typo in the man page of makegocons

* Update the print out based on the review comment, should not use  since the regular expression is removed

* Modify the nodeset disjoint test case accordingly for #4426

* Use short hostname in rcons for goconserver

As the certificate of xcat is signed with short hostname, this
commit force to use the short hostname in  the environment variable for
`congo console`.

* Fix issue 3497, make sense for reventlog msg

* Give summary after flash active when no debugmode

* Fix the issue that the IP configuration will fail if bmc attribute is a hostname

* enhance genimage for sles12sp2 (#4450)

* Add dhcp-client-identifier to lease block (#4429)

Machines that use Infiniband for PXE booting need to have the
dhcp-client-identifier set in the lease block.
Without it, they will not get the lease from the server.

* Support multiple bonds on bring-up

* modified depending on comments

* fix the check for rc to 1 on error cases

* modify response for bmcdiscover when error

* Ignore syslog error in monitorctrl when setNodeStatusAttributes (#4459)

* fix issue https://github.com/xcat2/xcat-core/issues/4411 (#4462)

* fix issue Compute nodes fail to get provisioned #4411: covert imgsrv and xcatmaster to their ip addresses in case the hostname cannot be resolved inside initrd for diskless

* More strict check to tell if it is a chroot env to avoid modify DB (#4463)

when genimage for SN image (#4365)

* issues for install license file on accton switches (#4460)

* Add test cases for rflash regular usage against openbmc

* modify depending on xuwei's comment

* add 2 more cases for option d

* enhance rflash upload message

* Do not display message for clearing dumps when only PNOR

* Display hostname even if multiple IP addresses

* modified depending on comments

* polished message

* Modify the default consoleondemand based on the global setting

This commit fix the bug that consoleondemand works incorrectly.

* modify depending on comments

* modified depending on comments

* enhance rflash error messages

* Modify documenation for servicenode attributes

* build rst file from Schema.pm by db2man

* change status back to starts

* modified depending on comments

* rm openbmcevents

* Usage and man page update for rspconfig dump

* let rflash error message flexible

* Add support for the "file -> (noderange) file" syntax in synclist with ServiceNodes (#4445)

* Add support for "file -  (noderange) file" in synclist when using
hierarchical mode. Fixes #4425

  This patch ensures that:
  1. the synclist is correctly parsed when running on a Service Node
  2. all files are synchronized to SNs in hierarchical mode

* Better test condition for #4425, addresses issue in
https://github.com/xcat2/xcat-core/pull/4445#issuecomment-349472901

* Fix issue 4477, if has node-<mac> will not create node-<mtms> for the same node

* fix issue updatenode -f loses directories when copying files to SN #4456 (#4494)

* comment from ErTao

* Crude attempt at including external configuration files in named.conf

* Fixes after the review

* Fix issue 4490, record any error when rflash active process

* add -d usage and manpage

* updatenode -F not work in hierachy env as the user name is FQDN of MN (#4484)

* updatenode -F not work in hierachy env (#4455)
 - add trace when -V is enabled
 - get the DSH_FROM_USERID from updatenode client

*  - when 'updatenode -F' need to push SN first, using root as non-root does not have permission write to 'SNsyncfiledir'
 - move the set DSH_FROM_USERID code out of the loop, and also cover remote client case.

* fix issue for command rspconfig hostname=*

* enhance rflash

* Adjust the server used for kernel/initrd and imgurl for petitboot (#4416)
 - URL for kernel/initrd, get the value from below value tftpserver -> xcatmaster -> myipfn
 - URL for image, get the value from below value nfsserver -> tftpserver -> xcatmaster -> myipfn

* NODE attribute didn't populate in /opt/xcat/xcatinfo after reboot (#4428)

* NODE attribute didn't populate in /opt/xcat/xcatinfo after reboot

* Get NODE from mypostscripts

* Improve the output message for reventlog, use a global variable to set PolicyFile Path

* If debug_msg is not provided, use an empty string

* Check for LinkLocal as well as 169.254 IP address

* Fix issue 4507, add parameter check for rspconfig admin_passwd

* record more information when rflash upload error

* Fix the error when using array ref in updatenode with old version perl, it is introduced by PR#4484 (#4518)

* Do not restart conserver if goconserver was started

If goconserver was enabled, do not start conserver when restart
xcatd on service node.

* remove the /etc/localtime before copy timezone file

* Use CONGO_CLIENT_TYPE to tell goconserver the source of client (#4501)

goconserver could send back message based on the client type
this commit set CONGO_CLIENT_TYPE to xcat to make the message
from goconserver more friendly.

* add rflash -d doc

* only ignore 169.254.x.x for OpenBMC

* Fix issue 4513, print out better error msg for reventlog -s

* Modify or add openbmc test cases or bundle

* add test cases for updatenode -f/F in hierarchy environment, covers issues #4456,#4455 and PR #4425 (#4500)
2017-12-14 05:03:34 -06:00
hu-weihua
a2df02fa48 modify depending on new requirement #4092 2017-10-17 03:54:58 -04:00
Bin Xu
a16ce72ae9 Merge pull request #4091 from hu-weihua/dhcp
To support rhels7.4 DHCP response format in detect_dhcpd tool
2017-10-13 15:56:05 +08:00
Bin Xu
66f31ff35d Make dbstat.py script could run by itself. 2017-10-13 10:03:57 +08:00
hu-weihua
eda410a169 To support rhels7.4 DHCP response format 2017-10-12 05:24:39 -04:00
zet809
852e996eff enhance clusterstatus to report cluster status (#3900)
* enhance clusterstatus to report cluster status

* modify usage for clusterstatus
2017-09-15 15:58:38 +08:00
chenglch
db37fd5dc0 Add script to analyze the db performance of xcat command (#3899)
This patch add a python script to calculate the time and the call
times from the command log file and syslog file.

Note: To get the correct data, the `dbtracelevel` option in site
table should be set to 4

implement: #3713

Support option:
```
usage: dbstats [--clusterlog CLUSTERLOG] [--commandlog COMMANDLOG] [-n NUM]
               [-c COMMAND]

Optional arguments:
  --clusterlog CLUSTERLOG
                        The syslog file of xcat.
  --commandlog COMMANDLOG
                        The command log file of xcat.
  -n NUM, --num NUM     The recent count of commands to analyze
  -c COMMAND, --command COMMAND
                        The specified command to track
```
2017-09-14 17:36:54 +08:00
XuWei
cb7be092b3 Delete genesis base built check in xcatprobe discovery pre-check 2017-09-14 01:41:00 -04:00
XuWei
118d62047e modified depending on comments 2017-09-12 02:28:25 -04:00
XuWei
ab464a1e87 Fix xcatprobe discovery pre-check issues 2017-09-11 23:08:57 -04:00
Mark Gurevich
36adad3d69 xcatprobe nodechect verify if any nodes at all 2017-09-05 13:55:02 -04:00
XuWei
e96a68d00a Fix issue 3825, if BOOTPROTO is none consider it as static IP in xcatprobe 2017-09-01 00:35:25 -04:00
ertaozh
94009a475d return errorcode 1 if failed for xcatprobe switch_macmap 2017-08-14 02:22:21 -04:00
XuWei
5afdb68a26 Fix typo error in xcatprobe discovery precheck 2017-08-06 22:17:46 -04:00
XuWei
a9c45279e1 modified depending on comments 2017-08-04 04:01:54 -04:00
XuWei
c3de2ea734 modified depending on comments 2017-08-03 03:35:47 -04:00
XuWei
5dcbe0fc78 Task 3554, enhance xcatprobe discovery precheck 2017-08-02 03:52:45 -04:00
Mark Gurevich
ad71fc9336 Initial pass for clusterstatus xcat probe 2017-06-27 13:47:03 -04:00
Samveen Gulati
f1b406dbc0 Reduce grep invocations by passing -[46] to ip 2017-06-06 09:53:29 +00:00
XuWei
66f8c5309b fix issue 2540, check noderange validity 2017-03-10 01:17:13 -05:00
XuWei
6d0bda0ff1 fix xcatprobe osdeploy performance bugs 2017-02-21 01:02:50 -05:00
XuWei
a162ca8420 change RPM to INSTALL 2017-02-14 04:47:45 -05:00
XuWei
c75ed21486 modified output title 2017-02-13 03:17:53 -05:00
XuWei
64b926ce63 modified table format 2017-02-10 02:22:54 -05:00
XuWei
17800828bf modified depending on comments 2017-02-09 01:51:09 -05:00
XuWei
7674577324 modified depending on comments 2017-02-06 21:35:23 -05:00
XuWei
6fdf3bef66 modified depending on comments 2017-01-24 20:36:19 -05:00
XuWei
97ca01394d xcatprobe osdeploy performance 2017-01-23 00:46:26 -05:00
XuWei
3bf88020c4 fix issue 2391, modify probe result format 2017-01-11 22:25:48 -05:00
zet809
6755a099d0 Merge pull request #2195 from neo954/issue1547-rpm-packaging
Make all the rpm packages have the exactly same version and release numbers
2017-01-10 17:27:54 +08:00
hu-weihua
08c0b81c47 fix issue#2384 2.13.1 xcatprobe xcatmn need modify firefall and diskspace check's output 2017-01-10 03:37:29 -05:00
XuWei
48a3d5ea68 fix typo bug in xcatprobe discovery 2017-01-10 02:46:35 -05:00
zet809
b88af7cbe3 Merge pull request #2365 from xuweibj/I1567
Fix issue 1567, check attribute switch & switchport
2017-01-10 14:49:13 +08:00
XuWei
42aee200dc Fix issue 1567, check attribute switch & switch port 2017-01-09 21:07:16 -05:00
Victor Hu
3bdf3b6383 Merge pull request #2370 from hu-weihua/2320
Fix bug#2320 Request changing xcatprobe xcatmn output messages for checking services
2017-01-09 10:01:25 -05:00
hu-weihua
9bfc34395b modify depending on Victor's comments 2017-01-09 01:07:01 -05:00
hu-weihua
1512f118dc Fix bug#2320 Request changing xcatprobe xcatmn output messages for checking services 2017-01-05 03:03:23 -05:00
neo954
327db76f9e Make all the deb packages have the exactly same version and release numbers 2017-01-03 12:56:15 +08:00
GONG Jie
65c2911888 Make all the rpm packages have the exactly same version and release numbers 2017-01-03 12:47:14 +08:00
Weihua Hu
f61d1944b9 Merge pull request #2339 from xuweibj/I2336
fix issue 2336, get correct mac address
2016-12-22 16:24:18 +08:00
XuWei
804fd4c4e5 fix issue 2336, get correct mac address 2016-12-22 01:59:55 -05:00
neo954
4383a4ff03 Merge pull request #2323 from hu-weihua/addhttp
Enhance xcatmn http service checking offer more error message and add ntp check
2016-12-21 02:42:34 -06:00
hu-weihua
0d3beb67c9 modify depending on gongjie'comment 2016-12-21 03:07:46 -05:00
hu-weihua
e3cfd47466 add ntp check and modify http part depending on gongjie's comment 2016-12-21 02:09:02 -05:00
XuWei
41f8c31ba1 add xcatprobe discovery time info when monitor 2016-12-19 01:23:42 -05:00
hu-weihua
4a0c497697 enhance http service checking, offer more error message 2016-12-19 00:47:52 -05:00
Weihua Hu
9a3f08e28e Merge pull request #2308 from xuweibj/osd213
enhance xcatprobe osdeploy functions
2016-12-16 16:44:13 +08:00
XuWei
34ab88985c modified depending on comments 2016-12-16 03:06:49 -05:00
xuweibj
10752d0604 Merge pull request #2309 from hu-weihua/2304
Fix issue#2304: xcatprobe subcommands are not consistent in their naming
2016-12-14 14:46:15 +08:00
hu-weihua
9ae9d9c2d2 change file name, replace hyphens by underscores 2016-12-14 01:32:24 -05:00