2
0
mirror of https://github.com/xcat2/xcat-core.git synced 2025-08-25 12:40:21 +00:00
Commit Graph

21077 Commits

Author SHA1 Message Date
Bin Xu
eea661e405 merge from master to 2.13 branch for 2.13.9 release. (1) (#4525)
* fix issueNode range not specified, see man page for syntax. return with no output when site.master is not set #4299

* Fix issue 4246, record rflash process in log file

* dodiscovery: better disksize - ordered by major,minor and no `\n` (#4219)

* better disksize: ordered by major,minor and no `\n`

* nodediscover:`disksize` sent correctly: no need to `split`,`join`

* general sort with explicit key columns, fix search pattern

* dodiscovery: Fix bugs

* dodiscovery: Fix ShellCheck SC2007,SC2004

* dodiscovery: simpler kcmdline parsing, disksize as IEC binary prefix

* Add test case - switch_to_dns_forward_mode

* Modify timeout of login by curl command for OpenBMC

* Add makegocons command

This patch enable goconserver service and manage the node sessions
with a new `makegocons` command.

Implement: #4215

* Refine the Cumulus Linux Section of the Doc (#4249)

* No content in the switches subdirectory in docs, remove

* Change the Network topic to Networking

* Refine and reformat the Cumulus Linux documentation

* Modify the script to build xCAT-genesis-base package (#4292)

* Verify hash ID

* change log messages

* Timeout the ntpd process if ntpd service is not running on ntpserver (#4321)

* enhance nodediscovery process: don't write "NOIP" if the node can not be resloved to an IP (#3995)

* enhance nodediscovery process, if only 1 mac and have \*NOIP\* append, don't write mac table and don't generate dhcp lease entry

* Enhance PR 3995: enhance nodediscovery process: don't write "NOIP" if the node can not be resloved to an IP

* modified depending on comments

* natural_sort_cmp: recursion to iterative implementation (#4314)

* natural_sort_cmp: recursion to iterative implementation

* natural_sort_cmp: correct prototype with parameters, as per `man perlfunc`

* Task 3339, rspconfig ip/netmask/gateway/vlan support

*   * Minor enhance on xcatperftest to put all logs into one file
  * Fix a bug in simulatorctl.sh, and it cause the script cannot be found

* modified depending on comments

* QA list for makehosts (#4284)

* QA list for makehosts

* Fix some bus in makegocons

* Revise test case - switch_to_dns_forward_mode

* Enhancements after the review

* Use IO::Socket to check BMC console port

* Revise test case - switch_to_dns_forward_mode

* modified depending on comments

* Add messages to inform the user of the general action started via xCAT for flashing firmware

* Fix bug, anything in the functional array is the one that's really active, priority will not be 0 if there is pending firmware

* Fix 4338, remove all of  in child process

* fix issue #4354 :The XCATTEST_CN in xcattest can not detect HCP as config file (#4355)

* Fix #4330, close the socket

* Add image name to /opt/xcat/xcatinfo on compute node (#4359)

* Integrate congo console from goconserver with rcons

Enhance the original implement of rcons to support goconserver.
`rcons` will help the user choose from one of the console backend
service based on the console server status of management node.

Implement #4216

* Fix 4363 - discovery broken (#4364)

* do not set exit_code to 1 when the clock is not synced before the timeout (#4362)

* Fix check for MTM values with spaces

* modified depending on comments

* rspconfig admin_password for OpenBMC

* Fix merging in xdcpmerge.sh (#4328)

* Fixes in xdcpmerge.sh

Two fixes:
1. The grep pattern when finding duplicate usernames is missing ":" at the end. So, for example user "test" would also match "test2, etc.". Adding the ":" delimiter fixes the issue.
2. Another issue happens when the file to be merged is a superset of the files on the nodes. For example, if a new user is added and entire passwd file (that is otherwise identical) is sent to be merged. In this case, the $filebackup.nodups file, i.e. the original file with duplicates removed, becomes empty and the condition "if [ -s "$filebackup.nodups" ]" does not execute. Then the merged file ends up being original file with the merge file fully appended, clearly not what was intended.

This is solved by changing the condition to check for file existence "-a" rather then for size. Additionally, I also turn the logic around so that the duplicates are removed from the merge file and then added to the original file. I think this makes logic a bit cleaner and also ensures that existing entries are not reordered or changed in any way.

* Streamlining previous commit

Adjustment to previous commit, streamlining and simplifying logic. Once $mergefile.nodups is created, just concatenate it the original file.

* Update to xdcpmerge

No need to copy $filebackup to $curfile, they are the same.

* Modify for debug conveniently

* add new cases and delete outdated test cases

* Modify genesis build script for centos x86_64

* Add space between at and the time

* Add a print out of the firmware levels for the various UT cases

* Add unit test cases for rspconfig

* rspconfig fix for set hostname

* Enhance the testing case for rspconfig setting hostname

* modified depending on comments

* modified depending on comments

* Add %pretrans script in <lua>. Handle directory to symlink change properly. See comment #3 of https://bugs.launchpad.net/rpm/+bug/633636

* Make xCAT-genesis-base confliects with early version of xCAT-genesis-scripts

* rspconfig dump to allow admins capture logs

* Adding comment

* Improve the error message when BMC does not return a dump ID

* Improve some messages and add timestamp for downloaded dump file

* Improve the message to help Admin figure out where the file is missing

* Leave a log file there when xCAT upgrade in case to debug issue while upgrading (#4389)

* Listen on 0.0.0.0 instead of the hostname

This patch modify the configuration of `makegocons` and `rcons`
for goconserver.

`cat /etc/goconserver/server.conf`
```
global:
  host: 0.0.0.0
  ssl_key_file: /etc/xcat/cert/server-key.pem
  ssl_cert_file: /etc/xcat/cert/server-cert.pem
  ssl_ca_cert_file: /etc/xcat/cert/ca.pem
  logfile: /var/log/goconserver/server.log
api:
  port: 12429
console:
  port: 12430
```

* Support hostname=* for openbmc

* Relay action and snmp configuration support for Coral PDU

* ddns.pm: specify the "directory" option for DNS slaves too (cf. bug #4392)

* Fix issue 4361, modify some sendmsg to message

* 1. add "makeconserver -d" to "rmdef -C", 2. add "makeconserver -C|--cleanup" to remove entries for removed nodes

* When there is a problem with the login, do not hide the message on debug mode. BMCReady does not make sense if the admin does not know how to find that state

* Change function from login_logout_request to login_request, not doing any logout here

* Check that RC is 200 to prevent unknown issues, handle the response generically

* OpenBMC rspconfig dump timeout fixes

* Fix issue 4408, modify error for rspconfig dump

* Clear all BMC Dump logs when BMC firmware flash

* modified depending on comments

* More modifications for pr 4386, to deal with the conflicts

* To handle one case which have 2 implementations, which one is for specific platform, on is for all platforms

* return when current status is RSPCONFIG_DUMP_DOWNLOAD_REQUEST

* fix issue 4417, delete 'clear next_status'

* fix issue 4353: rspconfig needs to support multiple IPs on the BMC and ignore ZeroConfigIPs

* Wait 15 seconds after OpenBMC interface with vlan tag to be activated

* Fix issue #4397: rspconfig <> hostname=xxx show error message when there is multiple network in bmc

* Some sentence modify for makeconservercf -C|--cleanup

* OpenBMC rspconfig dump better dump file name formatting

* Removed the --check and --ipsource option with PR 4258, update the man page

* Improve the message on the HTTP response

* modified depending on comments

* Only handle 404 and 504 in the login request code, defer the rest to deal_with_response()

* rflash stream support

* 1. configure ip/netmask/gateway only on the NIC whose IP match node BMC attribute, 2. add some information for LinkLocal address

* Fix confignetwork bond nic_type detection with multiple bonds

* Modified configonie --ntp command (#4436)

* Add man page for makegocons

This is the guide about how to make goconserver as
a replacement for conserver to help slove the issues reported
for conserver, like: #4043, #3543. For openbmc, the solution of
goconserver is much light-weighted than the conserver which could
help save the system resource. In addition, sshpass is not needed
for openbmc with goconserver.

Implement: #4337

* Add another key for node_info in order not to after the content of $node_info{$node}{bmc}

* enhance rflash stream

* makedhcp does not work well when all service nodes not running dhcp but disjointdhcps=1 (#4426) (#4440)

- if all service nodes not running dhcp, to treat it as disjointdhcps=0
- nodeset will send request to MN by default even if disjointdhcps=1
- Move out of the dhcp service checking from opts pre-check, and do it just before real makedhcp handling.

* rspconfig configure bmc vlan will hung because of PR 4383

* OpenBMC rspconfig dump enhancements

* Changes due to review comments

* Print debug message before login attempt

* Add warning when xCAT throttles SSL connections

* Display first [openbmc_debug] when entering openbmc.pm

* modified error msg

* Make sure credential files have a trailing newline (#4442)

* modified depending on comments

* Fix the typo in the man page of makegocons

* Update the print out based on the review comment, should not use  since the regular expression is removed

* Modify the nodeset disjoint test case accordingly for #4426

* Use short hostname in rcons for goconserver

As the certificate of xcat is signed with short hostname, this
commit force to use the short hostname in  the environment variable for
`congo console`.

* Fix issue 3497, make sense for reventlog msg

* Give summary after flash active when no debugmode

* Fix the issue that the IP configuration will fail if bmc attribute is a hostname

* enhance genimage for sles12sp2 (#4450)

* Add dhcp-client-identifier to lease block (#4429)

Machines that use Infiniband for PXE booting need to have the
dhcp-client-identifier set in the lease block.
Without it, they will not get the lease from the server.

* Support multiple bonds on bring-up

* modified depending on comments

* fix the check for rc to 1 on error cases

* modify response for bmcdiscover when error

* Ignore syslog error in monitorctrl when setNodeStatusAttributes (#4459)

* fix issue https://github.com/xcat2/xcat-core/issues/4411 (#4462)

* fix issue Compute nodes fail to get provisioned #4411: covert imgsrv and xcatmaster to their ip addresses in case the hostname cannot be resolved inside initrd for diskless

* More strict check to tell if it is a chroot env to avoid modify DB (#4463)

when genimage for SN image (#4365)

* issues for install license file on accton switches (#4460)

* Add test cases for rflash regular usage against openbmc

* modify depending on xuwei's comment

* add 2 more cases for option d

* enhance rflash upload message

* Do not display message for clearing dumps when only PNOR

* Display hostname even if multiple IP addresses

* modified depending on comments

* polished message

* Modify the default consoleondemand based on the global setting

This commit fix the bug that consoleondemand works incorrectly.

* modify depending on comments

* modified depending on comments

* enhance rflash error messages

* Modify documenation for servicenode attributes

* build rst file from Schema.pm by db2man

* change status back to starts

* modified depending on comments

* rm openbmcevents

* Usage and man page update for rspconfig dump

* let rflash error message flexible

* Add support for the "file -> (noderange) file" syntax in synclist with ServiceNodes (#4445)

* Add support for "file -  (noderange) file" in synclist when using
hierarchical mode. Fixes #4425

  This patch ensures that:
  1. the synclist is correctly parsed when running on a Service Node
  2. all files are synchronized to SNs in hierarchical mode

* Better test condition for #4425, addresses issue in
https://github.com/xcat2/xcat-core/pull/4445#issuecomment-349472901

* Fix issue 4477, if has node-<mac> will not create node-<mtms> for the same node

* fix issue updatenode -f loses directories when copying files to SN #4456 (#4494)

* comment from ErTao

* Crude attempt at including external configuration files in named.conf

* Fixes after the review

* Fix issue 4490, record any error when rflash active process

* add -d usage and manpage

* updatenode -F not work in hierachy env as the user name is FQDN of MN (#4484)

* updatenode -F not work in hierachy env (#4455)
 - add trace when -V is enabled
 - get the DSH_FROM_USERID from updatenode client

*  - when 'updatenode -F' need to push SN first, using root as non-root does not have permission write to 'SNsyncfiledir'
 - move the set DSH_FROM_USERID code out of the loop, and also cover remote client case.

* fix issue for command rspconfig hostname=*

* enhance rflash

* Adjust the server used for kernel/initrd and imgurl for petitboot (#4416)
 - URL for kernel/initrd, get the value from below value tftpserver -> xcatmaster -> myipfn
 - URL for image, get the value from below value nfsserver -> tftpserver -> xcatmaster -> myipfn

* NODE attribute didn't populate in /opt/xcat/xcatinfo after reboot (#4428)

* NODE attribute didn't populate in /opt/xcat/xcatinfo after reboot

* Get NODE from mypostscripts

* Improve the output message for reventlog, use a global variable to set PolicyFile Path

* If debug_msg is not provided, use an empty string

* Check for LinkLocal as well as 169.254 IP address

* Fix issue 4507, add parameter check for rspconfig admin_passwd

* record more information when rflash upload error

* Fix the error when using array ref in updatenode with old version perl, it is introduced by PR#4484 (#4518)

* Do not restart conserver if goconserver was started

If goconserver was enabled, do not start conserver when restart
xcatd on service node.

* remove the /etc/localtime before copy timezone file

* Use CONGO_CLIENT_TYPE to tell goconserver the source of client (#4501)

goconserver could send back message based on the client type
this commit set CONGO_CLIENT_TYPE to xcat to make the message
from goconserver more friendly.

* add rflash -d doc

* only ignore 169.254.x.x for OpenBMC

* Fix issue 4513, print out better error msg for reventlog -s

* Modify or add openbmc test cases or bundle

* add test cases for updatenode -f/F in hierarchy environment, covers issues #4456,#4455 and PR #4425 (#4500)
2017-12-14 05:03:34 -06:00
Victor Hu
e4f452a44d Merge pull request #4239 from whowutwut/update_man_pages_2.13
Looks like some man page updated were missed for 2.13.8 (2.13)
2017-11-03 15:12:24 -04:00
Victor Hu
f2421f8015 Looks like some man page updated were missed for 2.13.8 2017-11-03 15:04:10 -04:00
zet809
fe7405f170 Merge pull request #4227 from xcat2/master
Merge master to 2.13 branch for 2.13.8 release(2)
2.13.8
2017-11-02 15:05:35 +08:00
Weihua Hu
654ba50e91 Merge pull request #4226 from zet809/modify_release_info_for_2.13.8
modify release info for 2.13.8
2017-11-02 15:03:36 +08:00
zet809
c3c394d9eb Merge pull request #4174 from robin2008/stateless-sn-doc
Stateless service node RTD update
2017-11-02 15:00:53 +08:00
Bin Xu
cc5eaa15ba Fix the wrong path for xCATsn in both diskless_sn and diskfull_sn 2017-11-02 14:54:21 +08:00
ertaozh
d3160bda34 modify release info for 2.13.8 2017-11-02 02:38:22 -04:00
cxhong
01bf03de74 switch_macmap output showed mac address on the wrong port for cumulus (#4225)
switch
2017-11-01 21:46:04 -05:00
Victor Hu
4d06dc05e8 Merge pull request #4222 from cxhong/4221
bmcdiscover blathering garbage on non OpenBMC nodes
2017-11-01 13:14:32 -04:00
Casandra Qiu
469babefab bmcdiscover blathering garbage on non OpenBMC nodes 2017-11-01 13:03:20 -04:00
Bin Xu
6a2d713e29 adjust the old document structure for stateless sn 2017-11-01 22:35:36 +08:00
zet809
4036f216bf Merge pull request #4212 from mattaezell/quiet_discover
Quiet some debug messages during discovery
2017-11-01 13:33:22 +08:00
Matt Ezell
bae354316e Quiet some debug messages during discovery 2017-10-31 21:13:20 -04:00
zet809
0a25883b29 Merge pull request #4210 from xcat2/master
Merge master to 2.13 branch for 2.13.8 release(1)
2017-10-31 17:41:11 +08:00
zet809
f744bae33f Merge pull request #4207 from xuweibj/I4192
Fix issue 4192, fork to login before send real login request
2017-10-31 17:39:16 +08:00
XuWei
6a050f5974 Fix issue 4192, fork to login before send real login request 2017-10-31 05:31:56 -04:00
Weihua Hu
8d6ecf304d Merge pull request #4209 from bybai/fixvlan
fix wrong type for vlan in confignetwork and enhance testcases typo error
2017-10-31 16:14:36 +08:00
bybai
aa78a856f9 fix typo in confignetwork test cases 2017-10-31 03:15:18 -04:00
bybai
38bcab9dec fix vlan type 2017-10-31 03:14:32 -04:00
Bin Xu
149483dac5 Merge pull request #3905 from whowutwut/coral_reference_doc
CORAL Reference Documentation, initial skeleton
2017-10-31 10:18:23 +08:00
Victor Hu
8f66479f1b Added section for known issues, reduce the level being displayed 2017-10-30 16:29:05 -04:00
Victor Hu
c205aa5a71 Merge pull request #4184 from zet809/update_nvme_firmware
add the script to update nvme firmware
2017-10-30 10:41:36 -04:00
ertaozh
cc79123674 update script update_nvme_firmware based on Victor's comments 2017-10-30 09:15:42 -04:00
zet809
a69504b1bf Merge pull request #4168 from whowutwut/debug_rflash_openbmc
[OpenBMC] rflash -l, Reset the update_priority on each loop, or it will pick up the priority from the previous
2017-10-30 19:47:46 +08:00
Bin Xu
0133577acf Fix #4194, enhancement on xcatperftest (#4195)
1, add a new mode to run on existing environment
  2, adjust the output line format
  3, make the way to run mkdef be compatible with old release
  4, add PERF_CSV_CHAR variable to control the delimiter used in CSV report
2017-10-30 02:08:34 -05:00
zet809
46358c576a Merge pull request #4159 from samveen/fix_discovery
dodiscovery: get lan channel, dont use `1` (eg. `HP` uses `2`)
2017-10-30 13:57:43 +08:00
Victor Hu
a115e3b7a3 Change update_priority to local variable since it's only used inside the loop 2017-10-27 14:29:16 -04:00
Chuck Brazie
619593db4a Merge pull request #4188 from StevenGessner/verifyNode_1026
z/VM IVP should tolerate slow xcatd startup.
2017-10-27 10:10:42 -04:00
zet809
ce1c0859e1 Merge pull request #4147 from chuckbrazie/master_ChuckB_updatesSinceApril
Chuck Brazie updates since April, plus add back in xcatws.cgi from 2.13
2017-10-27 17:59:08 +08:00
zet809
151144f6bf Merge pull request #4151 from chenglch/rflash
Fix the spelling error for the openbmc rflash message
2017-10-27 17:53:39 +08:00
zet809
70a1c5b71e Merge pull request #4170 from whowutwut/bmc_reboot
[OpenBMC] Hide the 504 timeout when doing a reboot of BMC since the REST service may be down
2017-10-27 17:42:00 +08:00
chenglch
8ac900082e Merge pull request #3780 from samveen/apidocfix
Comment KeyFile instead of replacing as key is included in CertFile
2017-10-27 04:31:10 -05:00
Bin Xu
9abe96809b Fix 3026, ignore the rsetboot for openbmc box in petitboot during the stateful installation (#4193) 2017-10-27 04:10:47 -05:00
chenglch
21ea7f1160 Merge pull request #4131 from zet809/add_mlx5_for_genesis_base
add mlx5_ib,mlx5_core to genesis_base
2017-10-27 02:45:03 -05:00
zet809
7e7ba8b252 Merge pull request #4153 from xuweibj/reset_boot
rpower reset and boot for OpenBMC support
2017-10-27 15:41:05 +08:00
chenglch
1aca1aa60b Merge pull request #4191 from whowutwut/4053_multiple_args
Improve the parsing for rflash and detect error arguments in parsing
2017-10-26 21:35:09 -05:00
chenglch
607d3e229f Merge pull request #4185 from bybai/chdef
enhance chdef pre-check attribute
2017-10-26 21:34:51 -05:00
cxhong
6263ef39cd Add Node name to the /opt/xcat/xcatinfo for diskfull installation (#4190) 2017-10-26 21:28:52 -05:00
Victor Hu
d947e6b899 Improve the parsing for rflash and detect issues early on 2017-10-26 16:39:46 -04:00
cxhong
e4d18dd895 Merge pull request #4187 from whowutwut/improve_openbmc_debug_logging
[OpenBMC] Add timestamp to debug logging messages framework
2017-10-26 15:41:37 -04:00
Steven P. Gessner
1f1ef56e41 z/VM IVP should tolerate slow xcatd startup.
The IVP expects xcatd to be fully operational by the
time is begins a run.  It is possible for xcatd to
be delayed.  The delay should not ause a corruption
of the zvmnotify property in the site table.
In addition, tests for tabdump failures should be
corrected and the log file should be set up sooner
so that debug information is available for similar
problems.

Change-Id: I2b0e3e875cc28f740a35b348faa0cc74f5acb7bf
2017-10-26 14:33:00 -04:00
Victor Hu
22b7660b93 Add timestamp into the debug message in order to help trace the time
being spent in certain areas against the BMC.  Re-ordered the debug
logging to print BEFORE we issue the command in order to capture the correct
timestamp
2017-10-26 11:08:11 -04:00
cxhong
1ab870788c Modify setupntp postscripts (#4144)
* Modify setupntp postscripts

* exit after modifed ntp.conf
2017-10-26 09:53:18 -05:00
Victor Hu
08c4fc67ce Remove the indication of 504 and check that bmcreboot was the command called 2017-10-26 09:53:38 -04:00
cxhong
f20beb590a Merge pull request #4180 from whowutwut/fw1736
[OpenBMC] Inform the user of the workaround when running rsetboot with FW < 1738
2017-10-26 09:47:12 -04:00
Victor Hu
561c0b216f Merge pull request #4186 from whowutwut/security_20170828
Add security notice for openssl vulnerability for 8/28/17
2017-10-26 09:34:33 -04:00
Victor Hu
b6e25da523 Add security notice for openssl vulnerability for 8/28/17 2017-10-26 09:06:48 -04:00
bybai
5dd725e2fc enhance chdef pre-check attribute 2017-10-26 06:12:26 -04:00
ertaozh
116c651f7c add the script to update nvme firmware 2017-10-26 05:58:21 -04:00