Commit Graph

45 Commits

Author SHA1 Message Date
jbjohnso
ff8e2e21af -Increase db worker queue depth to avoid fatal table access errors
-Increase number of xCAT process slots to 512 from 16
-Increase Listen queue depth of xCAT to 8192 (needs to have proc value for somaxconn upped to actually make a difference)


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4027 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-22 13:18:55 +00:00
linggao
974f1dd4b2 bug fix on SQLite problem for getting column info
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4018 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-20 14:39:55 +00:00
linggao
15dfd3f270 added support1: newly added columns can by any data type now. support2: able to change the primary keys for a table when xcatd starts if the schema chenages
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4014 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-20 03:26:32 +00:00
jbjohnso
1aa8107eda -Make DB worker persist in the event of catastrophe and log the catastophre
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3994 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-13 14:32:22 +00:00
jbjohnso
b686ba5a10 -Move more aspects of a Table object to data worker thread, to reduce IPC communication hits
-Fix problem where data worker mode rendered cached operation useless
-Improved performance of data worker IPC communication (one benchmark went from 40 seconds to 2 seconds)


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3969 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-09 15:48:38 +00:00
jbjohnso
8172e9e17a -Fix CPU hogging by DB management process
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3967 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-07 17:04:43 +00:00
jbjohnso
aeb19d7eec -Change path to socket location of DB worker
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3961 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-06 12:58:14 +00:00
jbjohnso
59ad6ec44a -Change init of db worker to return pid
-Change presence of DB worker in ps output to be informative


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3960 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-06 12:44:22 +00:00
jbjohnso
5f8f6ae70e -Implement phase 1 of the DB worker, similar feature/performance with fewer db handles (up to two to accomodate some monitoring framework activity)
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3941 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-04 21:10:32 +00:00
jbjohnso
d9a5adea77 -Initial changes in preparation for db worker thread
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3937 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-04 18:38:08 +00:00
nott
81485eced5 Temporary fix for perl INC path issue.
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3927 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-03 13:07:29 +00:00
linggao
5c0eb55659 get table created when Table->new() is called without -create option
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3838 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-07-21 03:27:23 +00:00
jbjohnso
fd7accf225 -Remove confilicting hosts file entries
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3516 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-06-04 19:12:04 +00:00
linggao
467fa95c49 removed the extra print statement in Table.pm, xcat-Bugs-2777872
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3238 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-04-22 14:06:46 +00:00
jbjohnso
078aca4c5c -Correct typo in a SLES11 template.
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3214 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-04-17 16:35:54 +00:00
linggao
37db64b1e8 fix tabrestore to handle columns that are auto increment.
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2698 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-02-04 01:53:34 +00:00
linggao
7fba9cb39c added AUTO INCREMENT support for DB columns
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2657 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-01-27 17:53:44 +00:00
lissav
2aa7ab36dc more fixes to support mysql, chtab key=test site -d gives error
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2615 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-01-15 17:47:54 +00:00
jbjohnso
e5c3267933 -Prevent sqlite databases from being accessible by non-root users
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2609 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-01-15 15:04:05 +00:00
lissav
3a7ae3f20e fix usage of getAllEntries, adding a flag for all and default only entries that are not disabled
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2605 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-01-14 19:57:39 +00:00
linggao
f69ee3624e minor fix for plugable schema
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2603 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-01-14 19:03:37 +00:00
linggao
dd9da780a0 added support for user plugable database table. Phase 2
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2595 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-01-12 22:12:25 +00:00
jbjohnso
fda20c3ade -Fix problem where explicit nulls were presented subtly differently from implicit nulls
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2585 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-01-08 21:01:36 +00:00
lissav
2986895ee0 fix another place needs quotes for mysql
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2255 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-09-29 12:51:13 +00:00
lissav
5a590d9762 fix handling of tables that have a reserved word as an attribute ( non- key attribute) as in the prodkey table
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2233 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-09-26 12:32:23 +00:00
jbjohnso
09c9b1110f -Revert expression modification to Table for now
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2151 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-09-12 13:47:09 +00:00
jbjohnso
98aa5626fd Correct the scope of ''
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2139 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-09-11 01:57:01 +00:00
jbjohnso
7be4bcfbd8 -Specify scope of 'out' variable
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2138 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-09-11 01:53:44 +00:00
sikorsky
14600652bf Added special expressions for database table columns. Currently supported are "{hostname}", "{xcatmaster}". Any expression in braces is evaluated and replaced with some interpolated value. If expression is not defined, it's replaces by itself (ie. braces are deleted).
This feature helps keep database very clean and allows easier move of xCAT master from one host to another (define xcatmaster hostname on as few places as possible). Also will help HA setup.
Backwards compatible if not used. Has to be tested if used with service nodes.
In our environment we wanted to make xCAT highly available. Instead of some cluster solution we decided to install two independent xCAT masters. Using this feature we can have exactly the same xCAT database on two dirrefent nodes, so it's possible do backup on on node and restore on other node.
Usage example is in HA cookbook (TBD).


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2135 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-09-10 21:19:02 +00:00
jbjohnso
d97bf616bc -Fix problem in Table caching where nodelist table tramples it's own cache
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2094 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-09-07 21:08:13 +00:00
jbjohnso
2066d2619a -Fix SQLite functionality to work with new MySQL friendly Table schema syntax
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2073 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-09-04 19:40:01 +00:00
jbjohnso
31da9cc399 -Fix problem where invalid SQL was generated in previous Table update
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2063 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-08-27 21:19:18 +00:00
lissav
e3f2a2df37 Change to support MySQL
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2060 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-08-26 13:43:31 +00:00
jbjohnso
6636fb1fca -Fix regular expression without arithmetic expansion in |||
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@2046 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-08-20 16:47:39 +00:00
lissav
347eff6788 Remove incorrect comment about supporting only SQLite
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@1962 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-07-30 12:55:42 +00:00
jbjohnso
0cc1c7f198 -Fix Table bug where things that weren't a regex were treated as such
-Add columns to track serial console pointer and rvid pointer in VM table
-Clean up Xen rpower, store system serial and video information


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@1961 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-07-30 03:10:08 +00:00
jbjohnso
8da81ece39 -Fix syntax error in Table.pm
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@1878 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-07-14 14:35:54 +00:00
jbjohnso
6a158c171a -Check in a stub setNodesAttribs. It's as slow as setNodeAttribs, but the intent is to have it speed up with some attention later
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@1869 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-07-11 19:12:05 +00:00
jbjohnso
15409f472c -Optimize Table 'getAllNodeAttribs' function. makeconservercf now takes 1 second on 500 nodes, and less than 10 for 10,0000 on my test system
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@1860 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-07-10 13:40:32 +00:00
jbjohnso
08f3fb3ac5 -Table performance enhancements, makeconservercf, for example, a table set that induced a 10 second makeconservercf runtime is down to 3 seconds. (Now makeconservercf for this data set is an order of magnitude faster than 2.0, which was about 30 seconds for this test).
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@1850 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-07-09 12:43:57 +00:00
jbjohnso
ce8ee250d1 -Speed up noderange expansion
-Have Table calls that utilize noderange extend noderange's optimizations lifetime
-Rework conserver to use the at-scale Table access methods, overall about 3 times faster so far


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@1847 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-07-07 22:47:38 +00:00
jbjohnso
dea60262d8 -Modify getNodesAttribs to have a listref per node instead of one hashref
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@1845 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-07-07 19:08:26 +00:00
jbjohnso
c178d3937c -Implement a cached table lookup via getNodesAttribs, change xcatd to use that cached method for en-masse queries
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@1812 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-06-30 20:51:41 +00:00
jbjohnso
9dec80d60b -Check in unoptimized getNodesAttribs function for Table.pm
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@1809 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-06-30 13:51:44 +00:00
jbjohnso
77d55609c0 -Move perl-xCAT to not have version in trunk name
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@1562 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2008-06-03 15:00:37 +00:00