summaryrefslogtreecommitdiffstats
path: root/src/lib/Bcfg2
Commit message (Collapse)AuthorAgeFilesLines
* Client/Tools/POSIX: only execute needed directory installsAlexander Sulfrian2013-11-221-4/+13
| | | | | Remember the purge actions per Path entry, so that only needed install actions are executed.
* Client/Tools/POSIX: fix prune actionsAlexander Sulfrian2013-11-221-0/+2
| | | | | | | | The prune actions was not run. The fix that does not add multiple prune actions on multiple Verify runs in 7077358b1 does not set the pruneTrue flag during the later Verify runs and therefor the prune actions are ignored. This set the pruneTrue flag if the first Verify run, detected some entries that should be pruned.
* Client/Tools/POSIX: catch multiple VerifyDirectory callsAlexander Sulfrian2013-11-221-2/+9
| | | | | | If a directory should be pruned from all unknown files VerifyDirectory created a new entry each call and the second fails because the file was already removed.
* Reports/templates: mark hosts with extra packages in grid viewAlexander Sulfrian2013-11-221-0/+2
| | | | Clean hosts with extra packages get a blue background in grid view.
* Plugins/Packages/Portage: use keywords/use config everywhereAlexander Sulfrian2013-11-221-23/+1
|
* Plugins/Packages/Layman: add support for layman overlaysAlexander Sulfrian2013-11-222-0/+141
| | | | | | In combination with the PortageCollection the Packages plugin could now handle layman overlays. The Portage collection evaluates the dependencies with respect to the configured overlays.
* Plugins/Packages/Portage: add support for per-package flagsAlexander Sulfrian2013-11-221-1/+14
|
* Plugins/PkgVars: support multiple values per packageAlexander Sulfrian2013-11-222-4/+10
| | | | | If multiple values specified for one package all values are joined together in a set.
* Plugins/Packages/Portage: add Packages Plugin for PortageAlexander Sulfrian2013-11-221-0/+332
|
* Plugins/Packages/Collection: add cclass marker for SourcesAlexander Sulfrian2013-11-221-5/+7
| | | | | | | | | | | The classes of Sources could now specify another class for the Collection container. One host could only use one Collection class at a time. So all different Sources have to reference the same Collection. If no "cclass" is defined in the Sources class, the collection class name is generated by striping the "Source" string from the Sources class name like before.
* Client/Tools/APT: save new package version for auto pkgsAlexander Sulfrian2013-11-221-3/+5
| | | | | | For auto/any packages, currently only auto/any is stored in the statistics as the new installed version. This patch changes this behavior, so that the exact version string is saved additionaly.
* Packages/Apt: add name property to additional_dataAlexander Sulfrian2013-11-221-1/+1
|
* Packages/Apt: add pin attribute for extra pinning informationAlexander Sulfrian2013-11-221-1/+5
|
* Packages/Apt: add priority to additional_infoAlexander Sulfrian2013-11-221-1/+1
|
* Client: always actions do not modify hostsAlexander Sulfrian2013-11-221-1/+3
| | | | | Actions that are executed always, does not set the host statistics to modified. (One always action would lead to always modified hosts)
* Client: allow pre-Actions and important-Paths to enable installsAlexander Sulfrian2013-11-222-9/+21
| | | | | | | This is used to first update the apt repositories and than install all current versions in one bcfg2-run. Also the installation of software from custom repositories (that are configured on the client via bcfg2) should be possible on the first run.
* Plugins/PkgVars: new plugin to set various vars per packageAlexander Sulfrian2013-11-225-8/+95
| | | | | | | This plugins allows the setting of varius flags per package. It should be used f.e. to specify pinnings for debian packages or use flags and keywords for gentoo packages (needs to be implemented by future Portage plugin).
* Packages: add name to sourcesAlexander Sulfrian2013-11-221-0/+3
|
* Packages: add priority to sources and sort according to itAlexander Sulfrian2013-11-222-0/+5
|
* mark dependencies as automatic installedAlexander Sulfrian2013-11-221-0/+23
|
* Plugins/Packages: ability to overwrite recommended flag per packageAlexander Sulfrian2013-11-225-22/+68
|
* Version bump to 1.3.3v1.3.3Sol Jerome2013-11-072-2/+2
| | | | Signed-off-by: Sol Jerome <sol.jerome@gmail.com>
* Multiprocessing: removed unused importChris St. Pierre2013-11-061-1/+1
|
* Multiprocessing: don't reuse child RPC listenersChris St. Pierre2013-11-051-26/+7
|
* Merge pull request #143 from fennm/proxy-retry-on-ssl-errorChris St. Pierre2013-11-051-1/+0
|\ | | | | Proxy: Catch SSL errors and retry
| * Don't re-raise unknown exceptions per stpierreMichael Fenn2013-11-021-4/+0
| |
| * Proxy: Catch SSL errors and retryMichael Fenn2013-11-011-0/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The SSL library can throw an exception during the XMLRPC method call. There is no explicit except statement for this type of exception so they get raised up and abort the client's processing. This patch catches the exception so that normal retry processing occurs. Typical traceback: Traceback (most recent call last): File "/usr/sbin/bcfg2", line 29, in ? sys.exit(main()) File "/usr/sbin/bcfg2", line 26, in main return Client(setup).run() File "/usr/lib/python2.4/site-packages/Bcfg2/Client/Client.py", line 256, in run rawconfig = self.get_config(times=times).decode('utf-8') File "/usr/lib/python2.4/site-packages/Bcfg2/Client/Client.py", line 225, in get_config self.run_probes(times=times) File "/usr/lib/python2.4/site-packages/Bcfg2/Client/Client.py", line 151, in run_probes probes = Bcfg2.Client.XML.XML(str(self.proxy.GetProbes())) File "/usr/lib/python2.4/site-packages/Bcfg2/Proxy.py", line 81, in __call__ return _orig_Method.__call__(self, *args) File "/usr/lib64/python2.4/xmlrpclib.py", line 1096, in __call__ return self.__send(self.__name, args) File "/usr/lib64/python2.4/xmlrpclib.py", line 1383, in __request verbose=self.__verbose File "/usr/lib/python2.4/site-packages/Bcfg2/Proxy.py", line 331, in request return self.parse_response(response) File "/usr/lib64/python2.4/xmlrpclib.py", line 1255, in parse_response return self._parse_response(file, None) File "/usr/lib64/python2.4/xmlrpclib.py", line 1276, in _parse_response response = file.read(1024) File "/usr/lib64/python2.4/httplib.py", line 480, in read s = self.fp.read(amt) File "/usr/lib64/python2.4/socket.py", line 303, in read data = self._sock.recv(recv_size) File "/usr/lib64/python2.4/site-packages/M2Crypto/SSL/Connection.py", line 217, in read return self._read_bio(size) File "/usr/lib64/python2.4/site-packages/M2Crypto/SSL/Connection.py", line 202, in _read_bio return m2.ssl_read(self.ssl, size, self._timeout) M2Crypto.SSL.SSLError: (104, 'Connection reset by peer')
* | Admin: Don't call dead Mode.__call__ codeMichael Fenn2013-11-052-2/+0
|/ | | | | | | | | In 9eb3db84, Bcfg2.Server.Admin.Mode.__call__() was changed from pass to raise a NotImplementedError. This causes bcfg2-admin compare and bcfg2-admin snapshots to fail because they call Bcfg2.Server.Admin.Mode.__call__() right away. Since that method didn't do anything anyway, it seems expediant to just avoid the call altogether.
* Revert "Reporting: Simple sanity check to avoid creating too many threads"Michael Fenn2013-10-141-3/+0
| | | | | | | | This reverts commit f813f86f8ac2bc7b55f4eb6a0d936f1ce4f68ba7. Premature optimization is the root of all evil, etc. Conflicts: src/lib/Bcfg2/Reporting/Collector.py
* Reporting: misc improvements to collector threadingMichael Fenn2013-10-101-4/+6
| | | | | | 1. Use a better convention for calling the threading.Thread constructor 2. Add docstring to ReportingStoreThread.run 3. Give the storage thread variable a better name
* Merge remote-tracking branch 'upstream/maint' into ↵Michael Fenn2013-10-103-5/+8
|\ | | | | | | reporting-thread-each-data-import
| * Packages: fixed metadata.Packages["sources"]Chris St. Pierre2013-10-091-1/+1
| |
| * Metadata: read in clients.xml on every writeChris St. Pierre2013-10-041-0/+1
| | | | | | | | | | | | | | | | | | This ensures consistency between the in-memory representation of clients.xml and the representation on disk. If we don't read our writes immediately, there's a race condition when creating a new client: If it asserts its profile or version before the FAM event from the clients.xml edit is processed, then the clients doesn't appear to exist yet, and Bcfg2 complains.
| * Metadata: import any() from CompatChris St. Pierre2013-10-031-1/+3
| |
| * Core: Fixed error message on failed altsrc bindChris St. Pierre2013-09-301-3/+3
| |
* | Reporting: Simple sanity check to avoid creating too many threadsMichael Fenn2013-10-091-0/+3
| |
* | Reporting: start a new thread for each importMichael Fenn2013-10-091-10/+29
|/ | | | | | | | | | | | | | | | | When dealing with a high-latency database connection (eg. across a WAN), the bcfg2-report-collector process can fall behind in its import queue. The imports are very much bound by the response latency of the database server and not processing throughput. This patch fires off a new thread for each database interaction. The thread itself simply falls out of scope when the interaction is finished processing. The interaction object is still read from the disk serially in order avoid having to create a locking mechanism for that part of the process. This change does potentially create greater load on the database server, but ultimately the load is limited by rate at which the bcfg2 server can generate work.
* GroupLogic: fixed thread-local variable initializationChris St. Pierre2013-09-271-11/+13
|
* AWSTags: fixed cache clearing at start of client runChris St. Pierre2013-09-261-1/+1
|
* models: handle failure to import plugin gracefullyChris St. Pierre2013-09-261-1/+1
|
* Metadata: better logging when updating XML data failsChris St. Pierre2013-09-261-5/+6
|
* New plugin: AWSTagsChris St. Pierre2013-09-262-0/+218
| | | | | AWSTags allows querying tags from EC2, and setting groups based on the tag names or values.
* GroupLogic: avoid infinite recursion when using metadata.query in GroupLogicChris St. Pierre2013-09-231-0/+17
|
* GroupLogic: sort after other plugins so GroupLogic can use, e.g., Probe groupsChris St. Pierre2013-09-231-0/+3
|
* bcfg2-lint: Fixed Metadata check for duplicate groupsChris St. Pierre2013-09-171-9/+29
| | | | | | | | | The duplicate group check parsed groups differently from the actual groups.xml parsing routines; the latter followed the documentation, while the duplicate group check did now. This fixes the duplicate group check to parse groups.xml correctly when looking for duplicates. Fixes #140
* CfgPublicKeyCreator: properly handle case where only private key has been ↵Chris St. Pierre2013-09-162-25/+44
| | | | | | | | | created Previously, only two cases were handled properly: both public and private keys had been created; or neither had been created. If the private key had been created (e.g., manually added to the repo), the public key would not be created from it. This fixes that.
* Remove all ACLs (including mask) from entries with no ACLs listedChris St. Pierre2013-09-121-0/+5
| | | | | | When installing an entry with no ACLs specified, but with ACLs on the file as it exists on the filesystem, the ACL mask was preserved, even as the ACLs are deleted.
* XMLFileBacked: removed unused variableChris St. Pierre2013-09-111-1/+1
|
* XMLFileBacked: Fixed multiple identical XIncludes in one fileChris St. Pierre2013-09-111-12/+9
|
* bcfg2-lint: Added Cfg check for multiple global handlers for one entry setChris St. Pierre2013-09-091-1/+17
|