Alex Joh's Blog

Introduction From this series, all folder structure will be followed from the previous Multi environment stucture. The steps to create VMs are; Create Inventory file Create Variables Shared variables Group variables Create Ansible Playbook Creating VMs from CentOS Template Set Network interface Add MAC Address to dhcpd.conf Reboot Reference Github code Folders/Files list \---ansible | CreateVMs.yaml | +---inventory | +---shared_vars | | shared-secrets.yml (empty) | | shared-vars.yml (empty) | | | \---test | +---dmz | | | vm_hosts | | | | | \---group_vars | | vcenter.yml | | | \---internal | | vm_hosts | | | \---group_vars | secrets.yml (empty) | vcenter.yml | \---tasks

Introduction Until series 9, we've prepared to create Docker Cluster and to deploy microservices to the Cluster. From this series, we will start to deploy services to multiple environment. Architecture From one of our project, we want to automate from creating VMs to deploy microservices. I've looked at multiple difference options for automation. However, my choice is Ansible because it doens't need any additional installation on the remote machines. To march the entire steps, I segmented entire scopes to the following segments; Creating VMs from VMWare and manage ip addresses (CreateVMs.yaml) Creating Docker Cluster with Community edition (BuildDockerCECluster.yaml) Deploying default services such as Artifactory, Kong, etc (BuildDefaultMicroService.yaml) Build Docker private repository. Final choice is to use "Harbor" from VMware. Deploying custom solutions to Docker Cluster (DeployMicroservices.yaml) This is the entire drawing to support from the ab

Introduction Most time, I make screenshot to show folder structure, but whenever there is change, it is painful to make screen capture again and agian. This is how you can export folder structure to text file. Tree on Windows "tree.exe" is installed as default and you can run it from command prompt. d:\GitRepo\github\dockeransible>tree /? Graphically displays the folder structure of a drive or path. TREE [drive:][path] [/F] [/A] /F Display the names of the files in each folder. /A Use ASCII instead of extended characters. d:\GitRepo\github\dockeransible>tree d:\gitrepo\github\dockeransible /A /F > tree.txt d:\GitRepo\github\dockeransible>notepad tree.txt d:\GitRepo\github\dockeransible> Output from the command Folder PATH listing Volume serial number is D8A7-163B D:\GITREPO\GITHUB\DOCKERANSIBLE | README.md | tree.txt | +---2-CreateVM | CreateVM.yaml | +---4-AnsibleDebug | DisplayClonedVMInfo.yaml | +---5-Ad

Recently, I started to work AD authentication again and this is little snippet of AD authentication portion. Create simple springboot and tested with it. package com.alexjoh; import org.springframework.boot.SpringApplication; import org.springframework.boot.autoconfigure.SpringBootApplication; import java.io.IOException; import java.io.UnsupportedEncodingException; import java.util.Arrays; import org.apache.http.HttpEntity; import org.apache.http.HttpHost; import org.apache.http.auth.AuthScope; import org.apache.http.auth.NTCredentials; import org.apache.http.client.ClientProtocolException; import org.apache.http.client.CredentialsProvider; import org.apache.http.client.config.AuthSchemes; import org.apache.http.client.config.RequestConfig; import org.apache.http.client.methods.CloseableHttpResponse; import org.apache.http.client.methods.HttpGet; import org.apache.http.client.methods.HttpPost; import org.apache.http.client.protocol.HttpClientContext; import org.apache.http.entity

Running command on remote I need to run commands from remote and due to the password prompts, there was a challenge on it. To do this, "pexpect" module should be installed on the remote target computer. Prerequestic "pip" program on remote computer Need to install pexpect using pip program In my case, remote computer name is "docker01" and local computer name is "ns01". However, I recommend to install "pexpect" package on both computer Reference Github code Install pip and pexpect module [root@docker01 ansible]# yum install epel-release Installing : epel-release-7-9.noarch 1/1 Installed: epel-release.noarch 0:7-9 ... Complete!

Accessing host variable from playbook overview Before writing full script, I need to learn how to access variables from host file. I tried to use range varible from host variable, but this doesn't work. Host file filename is "dockerhosts" [dockermasters] dockermaster01 ipaddr=10.200.0.152 dockermaster02 ipaddr=10.200.0.153 [dockerworkers] dockerworkders01 ipaddr=10.200.0.154 dockerworkders02 ipaddr=10.200.0.155 dockerworkders03 ipaddr=10.200.0.156 YAML playbook file filename is "test.yaml" --- - name: Access Inventory Variable hosts: dockermasters connection: local # vars: # - ip: "{{ hostvars['hostname'][client_ip] }}" # - hostname: "{{ hostvars['hostname'][client_hostname] }}" tasks: - name: createVM from Template debug: var: hostvars[inventory_hostname]['ipaddr'] - name: show hostname debug: msg: "hostname is {{ inventory_hostname }}" Result [a

Running DNS and integrate with DHCP on CentOS We've reviewed how to add dhcp static IP address from DHCP and how to add it using ansible. This tutorial will show how to update DNS entry dynamically as soon as new IP is added into DHCP. Reference DDNS Reference DDNS Reference Steps to implement DDNS DNS setting dns domain name: svcdmztest.flair.local hostname: nsdmz01 ip: 10.201.0.30 Setup steps Install BIND, Bind-utils, and DHCP Generate Key (HMAC-SHA256 doesn't work this this version) Configure DNS(BIND) settings Configure DHCP settings Add filewall rules Modify nameserver Start DHCP and DNS service 1. Install BIND, Bind-utils and DHCP on CentOS If notname is not set, please set with hostnamectl [root@nsdmz01 log]# hostnamectl set-hostname nsdmz01 [root@nsdmz01 ~]# yum install bind bind-utils dhcp ... completed 2. Generate KEY To update DNS record, DHCP and DNS should have common key. Generate key [root@nsdmz01 ~]# dnssec-keygen -v 5 -a HMA

Change and Manage IP from cloned VM There is a challenge to manage hosts of cloned copies because template can't assign or change any information. For this, we are going to do this Running DHCP from ansible host Add ssh key to CentOS template to change configuration Preparing YAML Clone from template Read cloned mac address Add mac address to ansible dhcpconfig and assign ip address with static lease Start cloned copy Update hostname on the cloned copy 1) setup DHCP on ansible host Installing DHCP, sudo yum install dhcp [ansible@ansible01 test]$ sudo yum install dhcp Loaded plugins: fastestmirror, langpacks base | 3.6 kB 00:00:00 code | 2.9 kB 00:00:00 epel/x86_64/metalink | 12 kB 00:00:00 epel | 4.7 kB 00:00:00

Introdcution I've been using bitbucket cloud service and we would like to use pipeline, but we have a challenge on the library. Most project has library and will be needed our own repository. However, this has drawback to use pipleline if we set the repository type as private. We can't set the login and password from cloud. Implementation Steps Generate ssh key Upload the key to bitbucket setting Test bitbucket ssh connection Create Repsository in Bitbucket Add plugin to pom.xml Add repository to pom.xml Add distributeManagement to pom.xml Set login and password for the git protocol There are two ways to configure bitbucket as repository; one method is to use one repository with two different branch and the other mehtod is to use two different repositories to servce release and snapshot. We will choose 2nd choice. 1. Generate ssh key Run ssh-keygen to generate id_rsa.pub key $ ssh-keygen Generating public/private rsa key pair. Enter file in which to save the ke

Display Created/Provisioed/Cloned VM information using ansible This will demonstrate how to collected information from Ansible and show the value on the screen. Reference Ansible vshper_client {:rel=nofollow} Github code YAML file - name: Create VM from Template and Display Infomation hosts: localhost connection: local tasks: - name: Retrieve Cloned VM vsphere_guest: vcenter_hostname: 10.200.0.11 validate_certs: no username: administrator@vsphere.local password: password guest: centostemplate04 vmware_guest_facts: yes register: clonedvm - debug: var: clonedvm Result value [ansible@ansible01 test]$ ansible-playbook createtemplate.yml [WARNING]: Unable to parse /etc/ansible/hosts as an inventory source [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' PLAY [

Creating/Provisioing VM using ansible From this tutorial, we will create new VM from template file using vsphere_client. Reference Ansible vshper_client {:rel=nofollow} Deploy from template Deploying from template has two options for the target; 1. Cluster and 2. ESX host. resource_pool: A resource pool is a logical abstraction for flexible management of resources. Resource pools can be grouped into hierarchies and used to hierarchically partition available CPU and memory resources. Template: - name: Create VM from Template hosts: localhost connection: local tasks: - name: createVM from Template on Cluster - vsphere_guest: vcenter_hostname: 10.200.0.11 username: administrator@vsphere.local password: mypass guest: centostemplate01 from_template: yes template_src: CentOSTemplate cluster: FlairCluster resource_pool: "/Resources/Docker" vm_extra_config: folder: Docker - name: createVM from

Creating/Provisioing VM using ansible From this tutorial, I will demonstrate how to create empty VM using vsphere_client module. This is really simple example and most configuration file came from Ansible document Reference Ansible vshper_client {:rel=nofollow} Github code Installing pysphere module As specified from the above reference, we need to install pysphere module from python. [ansible@ansible01 ~]$ sudo pip install pysphere Collecting pysphere Downloading pysphere-0.1.7.zip (516kB) 100% |████████████████████████████████| 522kB 977kB/s Installing collected packages: pysphere Running setup.py install for pysphere ... done Successfully installed pysphere-0.1.7 [ansible@ansible01 ~]$ Checking VCenter options From the above reference, we will need to prepare following parameteres from VCenter. vcenter_hostname : this is the vcenter server name. In my case FLCATSVCT01(10.200.0.11) username : login for vcenter password : password for vcenter guest : guest

The goal of these series is building Prod, Test, and Dev environment, building docker cluster, and implemneting CI/CD using ansible for small team project. For repository, Artifactory OSS will be used. I've newbie on the Ansible. This series will show you how to install ansible program on Centos 7. OS Version Current version of CentOS [ansible@ansible01 ~]$ rpm --query centos-release centos-release-7-4.1708.el7.centos.x86_64 [ansible@ansible01 ~]$ Install Ansible 2.4 on CentOS 7.4 using pip pip is Python package manager and this will give me an unified way to install packages no matter what linux distribution. [ansible@ansible01 ~]$ sudo yum -y install python-pip .... Completed [ansible@ansible01 ~]$ sudo pip install ansible Collecting ansible Downloading ansible-2.4.3.0.tar.gz (6.5MB) 100% |████████████████████████████████| 6.5MB 135kB/s Collecting jinja2 (from ansible) Downloading Jinja2-2.10-py2.py3-none-any.whl (126kB) 100% |█████████████████████████████