Commit Graph

85 Commits

Author SHA1 Message Date
lissav
02bb6bb628 start of separating the creation of the db2 table logic from the other databases
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@5164 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2010-02-05 15:17:29 +00:00
jbjohnso
3ffa807168 -Reapply recent fixes lost in recent checkins
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@5020 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2010-01-22 20:08:33 +00:00
lissav
db7ddbb551 more db2 updates and added error message
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@5008 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2010-01-21 20:39:55 +00:00
lissav
cdbd665ed1 change to support DB2
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4981 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2010-01-19 19:34:46 +00:00
jbjohnso
d2cc0f30b6 -If children should occur, keep them from becoming zombies
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4900 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2010-01-06 20:03:48 +00:00
jbjohnso
3ff2c0eaaa -Fix setNodesAttribs syntax problem
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4891 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2010-01-05 15:23:42 +00:00
daniceexi
68de42c84b def commands performance enhancement: 1. fix performance issue in the getobjdefs; 2. def commands only get necessary attribute by getobjdefs; 3. lsdef without flags only displays node name; 4. rmobjdefs does not check the only_if condition; 5. Make Table::delEntries function can handle multiple records for a table
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4864 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-12-30 07:50:28 +00:00
linggao
6394de13d9 fixed problem for PostgreSQL when changing primary keys for a table
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4819 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-12-17 17:01:08 +00:00
lissav
f26e02f42f remove need to set ANSI_QUOTES for MySQL database
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4705 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-12-01 19:26:56 +00:00
jbjohnso
909517a2c5 -Add RHEL-6 alpha support for stateful deployment
-Fix bug in recent Table.pm enhancements


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4686 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-11-28 13:45:52 +00:00
jbjohnso
600fae75ef -Raise nodes at a time in the setNodesAttribs to 999 to account for the re-execute strategy allowing it to be that high
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4684 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-11-28 00:52:10 +00:00
jbjohnso
577661b712 -Change update strategy. Previous strategy of aggregated update statements acheived the lowest required execution of statements, but required a prepare per execute. This strategy uses a single prepare, though does not reduce execute. One prepare+thousands of executes is cheapare than a few dozen prepares+executes
Final tally:
    before this change, a particular stress test:
        real    0m48.731s
        real    0m54.434s
    after this change, the same test:
        real    0m3.231s
        real    0m2.976s



git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4675 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-11-26 18:22:17 +00:00
jbjohnso
c1a0633419 -Move setNodesAttribs to the DB worker
-Pass 1 of optimizing setNodesAttribs to be faster, may be followed by a strategy change based on experiments


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4674 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-11-26 18:01:38 +00:00
jbjohnso
8ccc09febd -Fix use of nodech to manipulate columns that are not 'node' but act like 'node (bug 2785190)
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4645 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-11-21 18:38:59 +00:00
linggao
3707ec41b5 fixed commit error for table creation on SQLite
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4464 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-10-29 16:24:04 +00:00
ligc
7ad4abe8f7 fix for bug 2844957: wait for clisock to be available in dbc_submit
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4447 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-10-26 09:56:54 +00:00
ligc
1fa38e9797 undo the last changes
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4446 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-10-26 09:53:35 +00:00
ligc
1c0226b313 fix for bug 2844957: wait for clisock to be available in dbc_submit
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4445 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-10-26 09:46:03 +00:00
jbjohnso
df9b3c3b16 -fix mistake in _clear_cache
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4432 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-10-21 16:31:53 +00:00
jbjohnso
cb2bef59b2 -When clearing DB handles, also clear the DB handle list
-Correctly map the database handle per 'realautocommit' (was causing xCAT to be unable to survive even one database disconnect).
-Fix problem where mapping from database handles to dependent objects was not being updated when the database handles changed (was causing xCAT to be unable to survive more than one database disconnect).
-Put in more comments so that people may understand the unusable db handle recovery code


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4401 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-10-16 18:53:28 +00:00
jbjohnso
081d90972e -Swap default to autocommit to be enabled by default and disable only
when a detected transaction is in progress (SQLite only)


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4394 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-10-15 18:32:39 +00:00
jbjohnso
a2da51211c -Have DB worker release potentially conflicting DB handles on startup
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4375 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-10-13 19:40:51 +00:00
jbjohnso
4fb91472c7 -Implement emulated autocommit for SQLite backend. Mixing and matching autocommit semantics was creating a deadlock. Emulated autocomment does not guarantee rollback to go back as far as one may expect
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4374 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-10-13 19:37:41 +00:00
jbjohnso
8fe6b85410 -Fix for bug 2873054
-Request to noderange to stop actively preserving cache now also has noderange to actively drop any current cache


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4341 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-10-10 14:50:06 +00:00
jbjohnso
712cb4fb4d -In the event of a bug caught by the DB worker, propogate it up to the client rather than having the client mysteriously hang
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4267 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-30 17:42:21 +00:00
jbjohnso
6bc4a63848 -Implement a nodegrpch command
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4262 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-29 20:41:13 +00:00
ligc
f38e2e552f fix for bug 2867833: wait database initialization in xcatd
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4242 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-27 03:02:46 +00:00
linggao
420fbc718d fixed Table.pm to get the primary key info in a different way for mysql
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4227 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-25 13:44:48 +00:00
jbjohnso
021f0e991a -Allow schema to specify a column to treat in the same special way that we treat 'node'
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4162 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-17 18:27:07 +00:00
jbjohnso
d02b8d9de8 -Fix for circumstances where a single Table object lifetime spans the period before DB worker is initialized and after
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4136 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-15 15:33:33 +00:00
jbjohnso
8d7d768230 -This guess at the memleak was incorrect and extraneous. It did introduce a bug, so revert it (if DB worker memory usage does not start leaking, no further thought required
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4128 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-14 15:49:10 +00:00
jbjohnso
1570da4d20 -Workaround the known place where 2.3 can leak memory, put notes in on how
to produce the memleak for future fix instead of workaround


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4112 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-09 20:08:51 +00:00
jbjohnso
43473e700a -Dereference some references before undef, in an attempt to ensure the perl GC can catch more available memory
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4108 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-08 20:49:48 +00:00
jbjohnso
15f3af3e40 -Make the regex operator in table more picky about syntax, to make a smaller set of data to be ambiguous
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4101 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-04 13:38:44 +00:00
jbjohnso
507446dfe8 -Fix hang when xcatd runs in background mode with stale DB handle fix
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4096 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-03 18:00:47 +00:00
jbjohnso
61ee396f44 -Detect dead database handles and recover (mysql haandles expire in 8 hours by default, for example, see wait_timeout to test with mysql)
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4095 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-03 16:33:55 +00:00
jbjohnso
298ac895e0 -Fix another scenario where cache was unintentionally living beyond it's accuracy
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4087 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-02 17:45:20 +00:00
jbjohnso
b2789bdede -Have cache persist a little longer to improve concurrent NodeRange expansion rather that slow it down
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4086 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-09-02 17:20:28 +00:00
linggao
fc986a252b removed the quotes for db columns that has the quotes after getting primary key info
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4064 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-31 19:52:33 +00:00
jbjohnso
95c0a1000d -Fix sf bug 2845378, stale cache data being returned in noderange expansions
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4057 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-27 19:57:41 +00:00
jbjohnso
ff8e2e21af -Increase db worker queue depth to avoid fatal table access errors
-Increase number of xCAT process slots to 512 from 16
-Increase Listen queue depth of xCAT to 8192 (needs to have proc value for somaxconn upped to actually make a difference)


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4027 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-22 13:18:55 +00:00
linggao
974f1dd4b2 bug fix on SQLite problem for getting column info
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4018 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-20 14:39:55 +00:00
linggao
15dfd3f270 added support1: newly added columns can by any data type now. support2: able to change the primary keys for a table when xcatd starts if the schema chenages
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@4014 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-20 03:26:32 +00:00
jbjohnso
1aa8107eda -Make DB worker persist in the event of catastrophe and log the catastophre
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3994 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-13 14:32:22 +00:00
jbjohnso
b686ba5a10 -Move more aspects of a Table object to data worker thread, to reduce IPC communication hits
-Fix problem where data worker mode rendered cached operation useless
-Improved performance of data worker IPC communication (one benchmark went from 40 seconds to 2 seconds)


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3969 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-09 15:48:38 +00:00
jbjohnso
8172e9e17a -Fix CPU hogging by DB management process
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3967 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-07 17:04:43 +00:00
jbjohnso
aeb19d7eec -Change path to socket location of DB worker
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3961 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-06 12:58:14 +00:00
jbjohnso
59ad6ec44a -Change init of db worker to return pid
-Change presence of DB worker in ps output to be informative


git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3960 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-06 12:44:22 +00:00
jbjohnso
5f8f6ae70e -Implement phase 1 of the DB worker, similar feature/performance with fewer db handles (up to two to accomodate some monitoring framework activity)
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3941 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-04 21:10:32 +00:00
jbjohnso
d9a5adea77 -Initial changes in preparation for db worker thread
git-svn-id: https://svn.code.sf.net/p/xcat/code/xcat-core/trunk@3937 8638fb3e-16cb-4fca-ae20-7b5d299a9bcd
2009-08-04 18:38:08 +00:00