Job crawler¶

Definition¶

R2Devops' crawler analyzes your GitLab repository to find jobs and include them in R2Devops Hub.

It searches for job in a given folder (folder_path). It will look for 3 specific files:

• <job_name>.yml or <job_name>.yaml
• README.md
• CHANGELOG.md

Once the files are analyzed, the crawler returns:

• A list of versions found.
• An analysis report with:
  • global warning and errors encountered during analysis.
  • warning and error for each version analyzed.

The rules¶

• A file named <job_name>.yml OR <job_name>.yaml at the root of the folder_path must be present
• To provide documentation: a README.md file must be present at the root of folder_path.
• To use versioning:
  • A CHANGELOG.md file must be present at the root of folder_path, following keepachangelog v1.0.0 format
  • The repo must have a git tag for each version listed in CHANGELOG.md
    • If the repo contains only one job: the git tag can be named following the job version(s) specified in the CHANGELOG.md file.
    • If the repo contains several jobs: the git tags have to be named using the job name as prefix like: <job_name>-<version>, with version corresponding to the job version(s) specified in the CHANGELOG.md file.

The workflow¶

The crawler's analysis happen in two times 👇🏻

Step 1: retrieve the version list¶

In this step, the crawler analyses your file and looks for the different versions of your job. No matter if there is a CHANGELOG.md file or not, the crawler will automatically create a version called latest. It corresponds to the actual version of your job, located on the default branch of your repository, independently of any tags.

Step 2: retrieve data for each version¶

Once the crawler has detected the versions of your job, we will check if the 3 files needed in order to create your job are available for each of your version.

Once all the versions are analyzed, the crawler gives feedback to R2Devop, and imports the versions of your job available in the platform!

Once your job is imported, you can add additional data, such as labels, the license and a description. You'll also be able to modify those data from your Jobs dashboard.