Rework ric-plt/lib/rmr CI jobs

* use descriptive name prefixes for C and Py jobs
* revise verify job for C to use cmake, not Docker
* add Sonar job for C
* revise Sonar job for Python to use new Sonarqube template

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Idc6de2d64505a3f7777fb3047b30a8f0fbee7808

Upgrade global-jjb to v0.51.1-11-gb55451a

This picks up new templates for CMake/Tox + SonarQube jenkins plugin.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Ibb83aca503c35e61f5d6c5dbfa22051851c311d7

Fix pti-rtp-shell-verify timeout issue

Increase Jenkins timeout on verify and merge from 60 to 120 min

Issue-ID: INF-17
Signed-off-by: Bin Yang <bin.yang@windriver.com>
Change-Id: Ifcab676af8ecb43b85ce824778fae97566d57673

Revert "I belive that we don't need mvn settings."

This reverts commit 66ae664a71b394377d1d65a2d46abb0cf1480896.

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: If36c1589cabe599dcb44caa6d523a3063eb18333

Merge "Update ubuntu1804-docker base image"

I belive that we don't need mvn settings.

All the maven settings are related to

nexus2 and 3 access, which is not applicable
however these are getting included as part of the
anchor

If they are a dependency they should not be and the job should
be fixed to reflect this.

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: Ia26c05673b8c2069da31bd7e7e7ba63ab4a7621f

Verify shouldn't verify docs.

Change-Id: Iad75d9a43b872bbe384e6c861c3698497b2b56f3
Signed-off-by: Tommy Carpenter <tc677g@att.com>

Correct xapp frame py to install rmr on verify.

Change-Id: I8942d4fd983f7884135a8bb1c2940ac5633817de
Signed-off-by: Tommy Carpenter <tc677g@att.com>

Update ubuntu1804-docker base image

The previous image doesn't have Go in the PATH. This one was built
using the ansible fix for the PATH issue.

Issue-ID: LF-Jira IT-18590
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
Change-Id: I760c1783b016122e319b7b5257553f10adf8a939

Merge "Add Go to path in /etc/environment"

Add Go to path in /etc/environment

Ubuntu isn't running /etc/profile.d/golang.sh. This will force the
addition of the Go path into the PATH var if it is missing.

Issue-ID: LF-Jira IT-18590
Change-Id: Ic2d3edce11897bc018f6ae2e2a542f46027a09fb
Signed-off-by: Eric Ball <eball@linuxfoundation.org>

Merge "Automation adds ric-plt-xapp-frame-cpp.yaml"

Merge "Automation adds ric-plt-alarm-cpp.yaml"

Automation adds ric-plt-alarm-go.yaml

Change-Id: I7a8d7a485046007820ef8105082e3368d7907936
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>

Automation adds ric-plt-xapp-frame-cpp.yaml

Change-Id: I9699e56601f9ba4460e4a8e5e7728b32c45a9ee4
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>

Automation adds ric-plt-alarm-cpp.yaml

Change-Id: I9edc366b50e41e5490a45e27654a784ca25a74a4
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>

Prepare job for xapp-frame-py

This is a hodgepodge of a1 and sdlpy; may need some lovin, most of the
confusion is around this requires this builder and this requires that
builder and this can use the default etc etc a list of what each builder
has or what each thing needs would go a long way

Change-Id: Iedb9e12fd19fcad231a7003353e8b89869d4381d
Signed-off-by: Tommy Carpenter <tc677g@att.com>

Improve jjb for pti rtp project

Refactor merge job to offload the image building process
to a new release job which will be triggered once or twice
per release. This helps save resources of ci infrastructure

Issue-ID: INF-15
Signed-off-by: Bin Yang <bin.yang@windriver.com>
Change-Id: I23ed988e06451622d9f144e5f4a1380c3eff86ee

Merge "Define o1 docker jobs verify, merge, release"

Merge "Upgrade go in Ubuntu 18 docker base image"

Merge "Reduce redundancy in ci-management docker jobs"

Upgrade global-jjb to v0.50.0-30-g2bd69d4

This pulls in new templates for generic sonar,
repair to failing cost function, etc.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I915f263b1c0a329a91bd5bdfdec20068608cff64

Reduce redundancy in ci-management docker jobs

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I17ae9a83b551eb944178b5c664be1d93f52cd628

Merge "Drop python debian base docker files"

Define o1 docker jobs verify, merge, release

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I273836086d6592b9ba516c0f928a37a2abcfad96

Upgrade go in Ubuntu 18 docker base image

- Upgrade golang 12 to version 1.12.16 and use as default
- Add golang version 1.13.7
- Add golangci-lint tool

Bump tag to prefix "4"

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I4807746311ec5b38e97664e86400f8e974f11374

Merge "add xapp base builder image"

Drop python debian base docker files

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Ia912982c69e4323f7b114a224f2d1a2426b117eb

Drop python debian base docker Jenkins job

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: If820bd8e98361482265dd4a59577a957edeacdbb

add xapp base builder image

Change-Id: I781920659fa2252bcaf3fcf22fc3d6278ce537d8
Signed-off-by: Tommy Carpenter <tc677g@att.com>

add verify job for new xapp base

Change-Id: I21ff57dbeb7601676d92e215269b6401aa9912a6
Signed-off-by: Tommy Carpenter <tc677g@att.com>

Merge "Add sonar job to nonrtric"

Update it/dep secret job build path

The it/dep secret generation job dockerfile and tag yaml files are moved due to R3 repo restructuring.
This patch updates the it/dep secret job to reflect the refactoring.

Signed-off-by: Zhe Huang <zhehuang@research.att.com>
Change-Id: Id293ffe9c2545e57482661e5aad672b273e541f6

Add INFO jobs for active O-RAN-SC repos

Ensure a info-yaml-verify job is configured for each active repo.
Use a top-level directory with a single YAML file for each active repo.
Initial configurations were generated from
https://gist.github.com/Aricg/c8144f33520b2b24a66ffc05c996a097

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: Ia2613e90a84dab28319ef949395e1cc982099c4f
Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>

Drop Jenkins config for archived project com/asn1

The com/asn1 repo is not active in the O-RAN-SC project

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Icd166820e2f15245adb50575abf9fe9cd99bdd06

Add sonar job to nonrtric

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Icd37d326779e75edfb39a61e02db0a14e6d74d4b

Verify helm charts on all branches

Use wildcard branch pattern to verify helm chart changes

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Ifacde7f635e2f86751df55bc0700a86f398ebfea

Update global-jjb to v0.50.0-13-g1fb55e8

Updates:
jjb/lf-python-jobs.yaml
jjb/lf-release-jobs.yaml
shell/jenkins-configure-clouds.sh

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: I38e080059022cb83e83e45b05ace947fd2b0019b

Need volume size of 20

centos builders need volume size of 20

error message:
aborted: Invalid input received:
Invalid input received: Size of
specified image 20GB is larger than
volume size 10GB

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: I87d14e20f1cc9170b9dee01948f4a617d3496623

Switch FLOATING_IP_POOL back to empty

Now that global-jjb has
https://gerrit.linuxfoundation.org/infra/c/releng/global-jjb/+/62991

we need to stop using public.
Also pull in new rtdv3 build script

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: I5c771b14d001b1cb79cfaf95c82127bf885af95e

Automation adds ric-plt-o1.yaml

Define project view and info-yaml-validate

Change-Id: If570f6bcde72de3c38574e594f8505d6aac53ba1
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>

FLOATING_IP_POOL is null.

null no longer works,
the inherited value of public is not being inherited.
rather it is being explicitly set to null.
floating_ip_pool=$(get_cfg "$cfg_file" FLOATING_IP_POOL "null")
This leads me to belive that
get_minion_options function will set the floating_ip
when set explicitly in the minion configs.

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: I422ce8f170894329ff8efd54970309cd619e2427

Merge "Set floating-ip-pool default to "public""

Set floating-ip-pool default to "public"

We have seen recent issues where the empty setting is being
interpreted as "null" rather than "No value". This breaks the cloud
config. We have a pool called "public" that should be set as the
default.

Signed-off-by: Eric Ball <eball@linuxfoundation.org>
Change-Id: Ife8a9bfbebfece6d3f82cfc00d71761fd0818656

global-jjb to v0.50.0-4-g8285615

This picks up a fix to jenkins-configure-clouds.sh that blocked
change of build minion images.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I7a4859893d1d2b2d0e76f5acc751ed52839e2dbd

Point maven to dashboard code with -f option

Reorganized portal/ric-dashboard repository to simplify job triggers
for code, docs and releases which avoids spurious job failures.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Ib8008760a165497eacf04e8f139f17fda3b8d852

global-jjb to v0.49.0-33-g0bc70d1

This picks up the repair to python-tools-install.sh that
caused the Python jobs script tox-install.sh to fail on
Ubuntu machines.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Iae6683ffa3bece93d9ad4aedfb9bb31322ffca9b

Upgrade docker minions to new images

ZZCI - CentOS 7 - docker - x86_64 - 20200123-164248.786
and
ZZCI - Ubuntu 18.04 - docker - x86_64 - 20200123-175351.393
are a newly created images with C, Golang, Java, Python, Ruby
and Docker.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I30633d3a804d27a4f994233671773e23216c0401

Re-add ruby and package_cloud install to packer

Removal of these was based on a faulty assumption. They still need to
be present.

Issue: LF-Jira IT-18593
Change-Id: Ic1f14e4e177b73ae07186153c8b72d81f95455ec
Signed-off-by: Eric Ball <eball@linuxfoundation.org>

Use pom in ricsdl-package for sonar analysis

The test coverage data file is written by tox into ricsdl-package,
so launch maven in that same directory, not in the repo root.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I9f462e76424681b7c03a90d126c46b81ac10451d

global-jjb to v0.49.0-29-gd92cb3e

Pulls in fix to support mvn-params for tox-sonar job

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Idbbd33d1f7af42d657a519971c383b4785522be9

global-jjb to v0.49.0-4-g078af58

This downgrades global-jjb to exclude a very recent change
to python-tools-install.sh.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I433150f7b9cb5edbddc20c68f078472d2a9a0968

Global-jjb to v0.49.0-28-g30fb028

Pulls in fix to support mvn-params for tox-sonar job

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I32b7440a8ff3b87e0052be7054a4d608b34fdcf9

Update to common-packer v0.4.0

This includes the latest base images.

Issue: LF-Jira IT-18593
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
Change-Id: Id0ee40cd17a0335b27cda8744498f7edeff7fb92

Switch to tested golang module, remove ruby

The previous golang module was not installing correctly on CentOS 7.
The gantsign module has been tested as working.
Ruby was only required for package_cloud, which is now installed in
the base image. Since it was causing build problems, the explicit
installation has been removed.

Issue: LF-Jira IT-15893
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
Change-Id: Ia60c965b0ddf0f04f634ff8cd9d8ff16ec190938

Merge "Set build-days-to-keep to 30 by default."

Skip build of dashboard docker image in Sonar job

Drop the override mvn-goal of 'test' and add maven parameter to tell
the Fabric8 maven plugin to skip building the Docker image because
no image is needed for Sonar analysis.  Previously I used goal "test"
to stop the maven build before it reached the install phase that builds
a Docker, but that phase does not call the jacoco-maven-plugin reporter.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Iaa924b41eb6d0034bdfacddec490d096e38f0a32

Set build-days-to-keep to 30 by default.

Build logs were being removed after 7 days which is too short.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I29e6be114a05878126f1b1fa38bc747f92386746

Use ansible ruby role to install gems

We're running into issues installing gems using "gem install"
commands, due to missing/outdated ruby version. Instead, we should
use a third-party ruby role, which will install a specific version of
ruby, and as a bonus, can handle installing the specific gems we want
as well.

Issue-ID: LF-Jira IT-18593
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
Change-Id: I3fe5987f17342d0d366eeed731d4f42687e1fc73

Update global-jjb to v0.49.0

We want the new read the docs v3 bits.

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: I2f7970d853d285a222723c8a9a003509d5f45f40

Merge "Change trigger branch pattern from master to *"

Change trigger branch pattern from master to *

The RTDv3 job needs to run on doc/ changes in all branches,
including the newly released Amber branch.

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I71ba71fc04aa0242c6827b2f8c41b09aaa4d00fd

Install golang 1.12 using ansible role from galaxy

Extend the playbook that provisions docker on build minions
to call fubarhouse.golang which downloads and installs golang
as specified by variable go_version.
Also add basic README for this directory.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I588aad142864d3257cb9255eebc2781ae02cad80

global-jjb to v0.48.1-33-g0bc0e97

Get new release-job feature for different git tag and version strings.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I09725140f4bff05e575d39653d61f35db80c47d6

Merge "Limit log archive pattern to top-level directory"

Limit log archive pattern to top-level directory

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I86686e5577855e6ad0abe65d7daf9e3a7d9ce353

global-jjb to v0.48.1-25-gaee2dcb

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I4d2bae79c259d0f4752e14cdd96682829b8afc83

Merge "Define jobs for ric-plt/sdlpy Python module"

Define jobs for ric-plt/sdlpy Python module

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Ia8c6ca32e9f61c814fddbcaa452ba6b2fad16fc0

Restore pypi merge job for master branch

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Ia1f5b87ddcd2737fce36fe2035db8f2b9883805f

Update global-jjb

Update global-jjb to allow for testing of packagecloud merge jobs.

Issue-Id: RELENG-2567
Signed-off-by: Houa Yang <hyang@contractor.linuxfoundation.org>
Change-Id: I58c6af63cbc0fd280aace33fdda3fc9c3c2660fa

Merge "Add release project to com-log"

Merge "Add PackageCloud.io release jobs for 'ric-plt/sdl'"

Merge "Add release project for ric-plt-tracelibcpp"

pti-rtp: change the build timeout to 1200 minutes.

The merge job for pti rtp repo runs out of allocated 9 hours with the
job half done. That implies to double time for building the image,
plus extra time for pushing the image to nexus repo, so increase the
timeout to 1200 to make sure the merge job will succeed. With that
success job execution, we could find out the exact building time and
change this timeout to be more accurate accordingly.

Evidence: https://jenkins.o-ran-sc.org/view/pti-rtp/job/
pti-rtp-shell-merge-master/5/console

16:49:20 NOTE: Running task 3957 of 7857

Issue-ID: INF-6
Signed-off-by: Jackie Huang <jackie.huang@windriver.com>
Change-Id: I74905a69d9b10895cf4af03c69e7633633e63724

Add PackageCloud.io release jobs for 'ric-plt/sdl'

Added configuration for 'ric-plt-sdl-packagecloud-release-verify' and
'ric-plt-sdl-packagecloud-release-merge' jobs.

Verified locally with 'jenkins-jobs test -r jjb' command.

Signed-off-by: Rolf Badorek <rolf.badorek@nokia.com>
Change-Id: I81ea60a5fe051d7f9a831dab54d1927c0278a695

Add release project for ric-plt-tracelibcpp

A project for releasing artifacts.

Change-Id: I69d9b297f29e9017ae884ec5c0f734013412a56e
Signed-off-by: Roni Riska <roni.riska@nokia.com>

Add release project to com-log

A project for releasing artifacts.

Change-Id: I7f3b867761720a1afc01e58088073532e6e962de
Signed-off-by: Roni Riska <roni.riska@nokia.com>

Merge "Add new builder with big storage"

Merge "adding go-acc and sonar"

adding go-acc and sonar

Change-Id: I7560bf22244e2239cced6540d9cb20ab2357f1dd
Signed-off-by: yakiratz <yaki.ratz@intl.att.com>

Add new builder with big storage

This is to support building ISO image from PTI RTP repo

Issue-ID: INF-6
Signed-off-by: Bin Yang <bin.yang@windriver.com>
Change-Id: I517b23c383bf60e2480a0d0201c8643c95c50b44

Change default.yaml mvn-*-id to site, staging

Change mvn-site-id to site; was oran-site
Change mvn-staging-id to staging; was oran-staging

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Ia58a93c5ae83206f3deb621b31d452c75a56d472

Merge "Add Jenkins job def for o-du/phy"

Add packagecloud verify & merge jobs

Add packagecloud verify & merge jobs to rmr project. Verify job
checks if package exists in staging, merge job promotes packages
from staging to release.

Issue-Id: RELENG-2130, IT-18339
Signed-off-by: Houa Yang <hyang@contractor.linuxfoundation.org>
Change-Id: I23bd634bfb52cd4c891b052c1ec2d4a8daf285b9

Add Jenkins job def for o-du/phy

Change-Id: I04352baae4724feb867b49091db2f77dce07db5c
Signed-off-by: wrider <lji@research.att.com>

Fix packagecloud global jjb job name

Fix naming of global jjb jobs for packagecloud verify & merge
job from gerrit-packagecloud-verify/merge to
gerrit-packagecloud-release-verify/merge.

Issue-Id: RELENG-2130, IT-18339

Signed-off-by: Houa Yang <hyang@contractor.linuxfoundation.org>
Change-Id: I273c16ff9d2b91ac3840e52a7f5e17bbcb236fed

Merge "Change serverID to site"

Change serverID to site

Issue-ID: INF-6
Signed-off-by: Bin Yang <bin.yang@windriver.com>
Change-Id: Ieb55728daf7ced849555fef2bb54dcf8aeb7456e

Add packagecloud verify & merge jobs

Add updated packagecloud verify & merge jobs. Verify job checks
if package exists in staging, merge job promotes packages from
staging to release.

Issue-Id: RELENG-2130, IT-18339
Signed-off-by: Houa Yang <hyang@contractor.linuxfoundation.org>
Change-Id: I9526de8c86a555805860684688143e6e7dd52748

Modify docker container image name for openlte

Modify the docker image name for this SCP repos to align
with LF releasing job expectation.  Docker image releasing
job expects "o-ran-sc" as container prefix as "LF umbrella"
because it uses the middle section of the Gerrit hostname.
Thus we change SCP repo container name to o-ran-sc/scp/ocu/openlte.

Change-Id: I105f84bafe345f46f02edf2b8a621f9deb26cb76
Signed-off-by: wrider <lji@research.att.com>

Merge "Initial JJB def for kpimon repo."

Merge "Add build-on-merge job for pti/rpt Yocto"

Add build-on-merge job for pti/rpt Yocto

Extend templates to provision global and project settings,
and to create netrc using mvn-site-id.
Refactor shell scripts into prereqs, verify, build and upload.
First draft of upload commands that deploy ISO to nexus.

Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: Ibce18bcdf05d99844673ba782d392379795ee945

Initial JJB def for kpimon repo.

Change-Id: I409ff65a689d8beb932a808d3dbc45613856b360
Signed-off-by: wrider <lji@research.att.com>

Merge "Prepare for docker image release for all RICP repos"

Merge "Prepare for docker image release for NONRTRIC repo"

Merge "Prepare for docker image release for RICAPP repos"

Merge "Add JJB for scp/ocu/openlte"

Merge "Prepare for docker image release for INT repos"