No description
  • C 60%
  • Python 22.5%
  • C++ 9.3%
  • Shell 4.7%
  • Perl 2.5%
  • Other 0.8%
Find a file
Benjamin Tovar cf5db1a048
vine: add prometheus instrumentation to python bindings. (#4433)
* vine: add prometheus to python bindings

The prometheus server runs as a separate process from the manager.
It gets information using status calls.

* documentation

* note on thread safety

* collect stats only after wait

* safer counting of stats

* remove default port for prometheus

* use only info from stats

* cleanup

* explicit fields

* prometheus_client from conda
2026-07-14 12:33:09 -04:00
.github github ci macos-13 to macos-15 (#4267) 2025-11-04 12:39:47 -05:00
batch_job CCTools: Add Deterministic Bucketing Algorithms (det-greedy, det-exhaust) (#4302) 2026-07-01 19:18:45 -04:00
chirp Iteration parameter for itable and htable (#4414) 2026-06-23 07:35:58 -04:00
deltadb Iteration parameter for itable and htable (#4414) 2026-06-23 07:35:58 -04:00
devel Iteration parameter for itable and htable (#4414) 2026-06-23 07:35:58 -04:00
doc vine: add prometheus instrumentation to python bindings. (#4433) 2026-07-14 12:33:09 -04:00
dttools WQ+Vine: Track Specific Cores Used (#4381) 2026-07-14 12:32:34 -04:00
ftp_lite github ci macos-13 to macos-15 (#4267) 2025-11-04 12:39:47 -05:00
grow grow: only use libs from config process (#4162) 2025-05-13 11:53:56 -04:00
makeflow CCTools: Add Deterministic Bucketing Algorithms (det-greedy, det-exhaust) (#4302) 2026-07-01 19:18:45 -04:00
packaging Catalog: Only compress catalog update messages when sending udp. (#4342) 2026-02-05 08:10:13 -05:00
parrot Iteration parameter for itable and htable (#4414) 2026-06-23 07:35:58 -04:00
poncho Library network code bugfix (#4247) 2026-01-06 12:04:27 -05:00
resource_monitor Iteration parameter for itable and htable (#4414) 2026-06-23 07:35:58 -04:00
taskvine vine: add prometheus instrumentation to python bindings. (#4433) 2026-07-14 12:33:09 -04:00
test_support/python_modules/python3/ndcctools Vine: Remove test for poncho to force test run. (#3422) 2023-07-28 16:01:49 -04:00
work_queue WQ+Vine: Track Specific Cores Used (#4381) 2026-07-14 12:32:34 -04:00
.clang-format Format: Fix Crazy Line Breaks (#3872) 2024-06-21 13:41:08 -04:00
.gitattributes Whitespace rules for this project. 2015-06-09 10:41:09 -04:00
.gitignore Vine: Add flake8 to lint Python code of TaskVine (#3465) 2023-08-18 08:39:49 -04:00
.module.mk Vine: Clean Up Mini-Tasks (#3577) 2023-11-17 16:02:02 -05:00
.readthedocs.yaml update readthedocs ubuntu (#4392) 2026-04-22 18:32:10 -04:00
configure use the getopt from the system (#4260) 2025-11-03 12:19:47 -05:00
configure.tools.sh Batch: Rework Interface Into Queue, Task, File Objects (#3898) 2024-08-06 10:42:00 -04:00
COPYING Add a good PRNG (mersenne twister) for cctools. 2014-10-01 15:42:23 -04:00
CREDITS General Cleanup (#3452) 2023-08-11 13:59:07 -04:00
environment.yml vine: add prometheus instrumentation to python bindings. (#4433) 2026-07-14 12:33:09 -04:00
hi.txt Hungry feature (#3949) 2024-10-15 11:03:29 -04:00
Makefile PLEDGE: Unified under 1 binary (#4212) 2025-07-11 12:40:21 -04:00
README.md Recommend Miniforge instead of Miniconda and remove Python 3.9 note in install documentation (#3932) 2024-09-16 14:31:54 -04:00
rules.mk split out recipe with two targets to avoid gmake deprecation (#4317) 2026-01-13 11:52:39 -05:00
run_all_tests.sh Vine: Mini Tasks (#3046) 2022-11-21 16:11:01 -05:00
STYLE.md Fix link syntax. 2023-08-17 14:37:45 -04:00

The Cooperative Computing Tools

About

The Cooperative Computing Tools (cctools) is a software package for enabling large scale distributed computing on clusters, clouds, and grids. It is used primarily for attacking large scale problems in science and engineering.

You can read more about this software at ReadTheDocs It is developed by members of the Cooperative Computing Lab at the University of Notre Dame, led by Prof. Douglas Thain. The file CREDITS lists the many people that have contributed to the software over the years.

Quick Install Via Miniforge

The easiest way to install the binaries is via Miniforge, a light version of Anaconda

conda install -y -c conda-forge ndcctools

Build From Source

To build from source and install in your home directory:

git clone git://github.com/cooperative-computing-lab/cctools.git cctools-src
cd cctools-src
unset PYTHONPATH
conda env create -y -f environment.yml
./configure --with-base-dir $CONDA_PREFIX --prefix $CONDA_PREFIX
make
make install

Then run the executables out of your home directory like this:

export PATH=$HOME/cctools-src/bin:$PATH
makeflow -v
vine_status
------------------------------------------------------------
This software package is
Copyright (c) 2003-2004 Douglas Thain
Copyright (c) 2005-2022 The University of Notre Dame
This software is distributed under the GNU General Public License.
See the file COPYING for details.
------------------------------------------------------------
This product includes software developed by and/or derived
from the Globus Project (http://www.globus.org/)
to which the U.S. Government retains certain rights.
------------------------------------------------------------
This product includes code derived from the RSA Data
Security, Inc. MD5 Message-Digest Algorithm.
------------------------------------------------------------
This product includes public domain code for the
SHA1 algorithm written by Peter Gutmann, David Ireland,
and A. M. Kutchman.
------------------------------------------------------------
This product includes the source code for the MT19937-64
Mersenne Twister pseudorandom number generator, written by 
Makoto Matsumoto and Takuji Nishimura.