I use for configuration bamboo 5.7.1 and all configuration will be done from script - I not use plugins
First I prepare build project consists from 2 stages
- one for prepare package - for example zip file
- two for update package to repository - NEXUS
When I have zip file to upload to NEXUS I use NEXUS api to upload file
#use timestamp to versioning
VERSION=`echo "${bamboo.buildTimeStamp}" | sed 's/:/-/g' | cut -f 1 -d "."`
#uploadcurl -v \
-F "r=releases" \
-F "g=pl.company.sql" \
-F "hasPom=false" \
-F "a=db" \
-F "c=${bamboo.buildResultKey}" \
-F "p=zip" \ -F "v=$VERSION" \
-F "file=@./$f" \
-u deployment:${bamboo.nexuspassword}\
http://service/nexus/service/local/artifact/maven/content
important is use classifier
or You can use MAVEN
Second - download script for deployment project
#Fix mapping between buildResultKey
CLASS=`echo ${bamboo.buildResultKey} | sed 's/-/-RDP-/2'`
-For more information see post below and continue
#find package by classifier
VERSION=`curl -u deployment:${bamboo.nexuspassword} "http://service/nexus/service/local/lucene/search?g=$GROUP&a=$ARTIFACT&c=$CLASS&r=$REPO" | sed -n 's|<version>\(.*\)</version>|\1|p' | sed -e 's/^[ \t]*//' -e 's/[ \t]*$//'`
#Download by wget
wget -O db-sprint.zip --user deployment --password=${bamboo.nexuspassword} "http://service/nexus/service/local/artifact/maven/content?r=$REPO&g=$GROUP&a=$ARTIFACT&v=$VERSION&p=zip&c=$CLASS"
Monday 29 December 2014
Configure mapping between build project and deployment project in Bamboo
Atlassian Bamboo don't have formal mapping between build project and deployment project but you can use buildResultKey - it constain number of build which is constant.
I create build plan and deployment plan in deployment plan set to update buildResultKey to be correct for deployment plan
echo ${bamboo.buildResultKey} | sed 's/-/-JOB1-/2'
You shoud list buildResultKey variable in build project and deployment project and check difference - for me it is JOB1
I create build plan and deployment plan in deployment plan set to update buildResultKey to be correct for deployment plan
echo ${bamboo.buildResultKey} | sed 's/-/-JOB1-/2'
You shoud list buildResultKey variable in build project and deployment project and check difference - for me it is JOB1
Monday 13 January 2014
Targetcli performance - 1Gbit network
Testing targetcli - cofigured in Targetcli configuration iSCSI
create ramdrive on target
mount -t tmpfs -o size=7G tmpfs /mnt/ramd
Create file in ramdrive
dd if=/dev/zero of=/mnt/ramd/test1 bs=1024 count=6000000
6000000+0 records in
6000000+0 records out
6144000000 bytes (6.1 GB) copied, 8.75343 s, 702 MB/s
Map file to datastore in targetcli
Connect to target
iscsiadm -m node --targetname "iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.1a7b82ef561a" --portal "192.168.42.135:3260" --login
Logging in to [iface: default, target: iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.1a7b82ef561a, portal: 192.168.42.135,3260]
Login to [iface: default, target: iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.1a7b82ef561a, portal: 192.168.42.135,3260] successful.
dmesg | tail
[3658097.364033] sd 11:0:0:0: [sdc] Write Protect is off
[3658097.364033] sd 11:0:0:0: [sdc] Mode Sense: 43 00 00 08
[3658097.364559] sd 11:0:0:0: [sdc] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[3658097.365159] sd 11:0:0:0: [sdc] 12000000 512-byte hardware sectors (6144 MB)
[3658097.365463] sd 11:0:0:0: [sdc] Write Protect is off
[3658097.365463] sd 11:0:0:0: [sdc] Mode Sense: 43 00 00 08
[3658097.365945] sd 11:0:0:0: [sdc] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
Create partition
fdisk /dev/sdc
Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel
Building a new DOS disklabel with disk identifier 0xf5daec87.
Changes will remain in memory only, until you decide to write them.
After that, of course, the previous content won't be recoverable.
Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)
WARNING: DOS-compatible mode is deprecated. It's strongly recommended to
switch off the mode (command 'c') and change display units to
sectors (command 'u').
Command (m for help): n
Command action
e extended
p primary partition (1-4)
p
Partition number (1-4): 1
First cylinder (1-1018, default 1):
Using default value 1
Last cylinder, +cylinders or +size{K,M,G} (1-1018, default 1018):
Using default value 1018
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table.
Syncing disks.
Create filesystem and mount
mkfs.ext3 /dev/sdc1
mount /dev/sdc1 /mnt/istest
Write test on initiator
dd if=/dev/zero of=/mnt/istest/test1 bs=1024 count=5600000
5600000+0 records in
5600000+0 records out
5734400000 bytes (5.7 GB) copied, 46.0264 s, 125 MB/s
iSCSI reach network interface limit - 1Gbit
CPU usage on iSCSI target
top - 19:07:58 up 50 min, 1 user, load average: 0.00, 0.01, 0.05
Tasks: 107 total, 2 running, 105 sleeping, 0 stopped, 0 zombie
%Cpu(s): 0.0 us, 7.5 sy, 0.0 ni, 92.4 id, 0.0 wa, 0.0 hi, 0.2 si, 0.0 st
KiB Mem: 10268436 total, 6240584 used, 4027852 free, 9448 buffers
KiB Swap: 561148 total, 0 used, 561148 free, 6138880 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
3037 root 20 0 0 0 0 R 17.3 0.0 0:03.89 iscsi_trx
3036 root 20 0 0 0 0 S 1.3 0.0 0:00.28 iscsi_ttx
After configuring multipath on client - initiator
sc-srv-006:~# dd if=/dev/zero of=/mnt/istest/test1 bs=1024 count=5600000
5600000+0 records in
5600000+0 records out
5734400000 bytes (5.7 GB) copied, 29.79 s, 192 MB/s
Network statistics from target iSCSI
root@sc-azl-001:~# ethstats
total: 0.01 Mb/s In 0.00 Mb/s Out - 15.0 p/s In 0.0 p/s Out
eth0: 0.01 Mb/s In 0.00 Mb/s Out - 8.0 p/s In 0.0 p/s Out
eth1: 0.01 Mb/s In 0.00 Mb/s Out - 7.0 p/s In 0.0 p/s Out
total: 2.04 Mb/s In 0.07 Mb/s Out - 244.9 p/s In 97.8 p/s Out
eth0: 0.98 Mb/s In 0.04 Mb/s Out - 121.0 p/s In 47.3 p/s Out
eth1: 1.06 Mb/s In 0.04 Mb/s Out - 123.9 p/s In 50.5 p/s Out
total: 288.21 Mb/s In 1.37 Mb/s Out - 24193.5 p/s In 2389.0 p/s Out
eth0: 152.06 Mb/s In 0.67 Mb/s Out - 12790.5 p/s In 1154.3 p/s Out
eth1: 136.15 Mb/s In 0.70 Mb/s Out - 11403.0 p/s In 1234.7 p/s Out
total: 1307.89 Mb/s In 6.22 Mb/s Out - 110060.5 p/s In 10903.6 p/s Out
eth0: 666.02 Mb/s In 2.97 Mb/s Out - 56061.4 p/s In 5172.4 p/s Out
eth1: 641.87 Mb/s In 3.25 Mb/s Out - 53999.1 p/s In 5731.2 p/s Out
total: 1286.38 Mb/s In 6.15 Mb/s Out - 108248.9 p/s In 10771.6 p/s Out
eth0: 642.20 Mb/s In 2.88 Mb/s Out - 54058.7 p/s In 5011.2 p/s Out
eth1: 644.18 Mb/s In 3.27 Mb/s Out - 54190.2 p/s In 5760.4 p/s Out
total: 1294.30 Mb/s In 6.19 Mb/s Out - 108921.4 p/s In 10854.0 p/s Out
eth0: 648.03 Mb/s In 2.92 Mb/s Out - 54556.0 p/s In 5089.5 p/s Out
eth1: 646.27 Mb/s In 3.27 Mb/s Out - 54365.4 p/s In 5764.5 p/s Out
total: 631.95 Mb/s In 3.05 Mb/s Out - 53211.1 p/s In 5316.6 p/s Out
eth0: 296.08 Mb/s In 1.34 Mb/s Out - 24938.3 p/s In 2310.2 p/s Out
eth1: 335.87 Mb/s In 1.71 Mb/s Out - 28272.8 p/s In 3006.4 p/s Out
create ramdrive on target
mount -t tmpfs -o size=7G tmpfs /mnt/ramd
Create file in ramdrive
dd if=/dev/zero of=/mnt/ramd/test1 bs=1024 count=6000000
6000000+0 records in
6000000+0 records out
6144000000 bytes (6.1 GB) copied, 8.75343 s, 702 MB/s
Map file to datastore in targetcli
Connect to target
iscsiadm -m node --targetname "iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.1a7b82ef561a" --portal "192.168.42.135:3260" --login
Logging in to [iface: default, target: iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.1a7b82ef561a, portal: 192.168.42.135,3260]
Login to [iface: default, target: iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.1a7b82ef561a, portal: 192.168.42.135,3260] successful.
dmesg | tail
[3658097.364033] sd 11:0:0:0: [sdc] Write Protect is off
[3658097.364033] sd 11:0:0:0: [sdc] Mode Sense: 43 00 00 08
[3658097.364559] sd 11:0:0:0: [sdc] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[3658097.365159] sd 11:0:0:0: [sdc] 12000000 512-byte hardware sectors (6144 MB)
[3658097.365463] sd 11:0:0:0: [sdc] Write Protect is off
[3658097.365463] sd 11:0:0:0: [sdc] Mode Sense: 43 00 00 08
[3658097.365945] sd 11:0:0:0: [sdc] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
Create partition
fdisk /dev/sdc
Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel
Building a new DOS disklabel with disk identifier 0xf5daec87.
Changes will remain in memory only, until you decide to write them.
After that, of course, the previous content won't be recoverable.
Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)
WARNING: DOS-compatible mode is deprecated. It's strongly recommended to
switch off the mode (command 'c') and change display units to
sectors (command 'u').
Command (m for help): n
Command action
e extended
p primary partition (1-4)
p
Partition number (1-4): 1
First cylinder (1-1018, default 1):
Using default value 1
Last cylinder, +cylinders or +size{K,M,G} (1-1018, default 1018):
Using default value 1018
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table.
Syncing disks.
Create filesystem and mount
mkfs.ext3 /dev/sdc1
mount /dev/sdc1 /mnt/istest
Write test on initiator
dd if=/dev/zero of=/mnt/istest/test1 bs=1024 count=5600000
5600000+0 records in
5600000+0 records out
5734400000 bytes (5.7 GB) copied, 46.0264 s, 125 MB/s
iSCSI reach network interface limit - 1Gbit
CPU usage on iSCSI target
top - 19:07:58 up 50 min, 1 user, load average: 0.00, 0.01, 0.05
Tasks: 107 total, 2 running, 105 sleeping, 0 stopped, 0 zombie
%Cpu(s): 0.0 us, 7.5 sy, 0.0 ni, 92.4 id, 0.0 wa, 0.0 hi, 0.2 si, 0.0 st
KiB Mem: 10268436 total, 6240584 used, 4027852 free, 9448 buffers
KiB Swap: 561148 total, 0 used, 561148 free, 6138880 cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
3037 root 20 0 0 0 0 R 17.3 0.0 0:03.89 iscsi_trx
3036 root 20 0 0 0 0 S 1.3 0.0 0:00.28 iscsi_ttx
Tested in virtual machine with 10GB RAM, 2 core (phisycal cpu xeon E5520)
After configuring multipath on client - initiator
sc-srv-006:~# dd if=/dev/zero of=/mnt/istest/test1 bs=1024 count=5600000
5600000+0 records in
5600000+0 records out
5734400000 bytes (5.7 GB) copied, 29.79 s, 192 MB/s
Network statistics from target iSCSI
root@sc-azl-001:~# ethstats
total: 0.01 Mb/s In 0.00 Mb/s Out - 15.0 p/s In 0.0 p/s Out
eth0: 0.01 Mb/s In 0.00 Mb/s Out - 8.0 p/s In 0.0 p/s Out
eth1: 0.01 Mb/s In 0.00 Mb/s Out - 7.0 p/s In 0.0 p/s Out
total: 2.04 Mb/s In 0.07 Mb/s Out - 244.9 p/s In 97.8 p/s Out
eth0: 0.98 Mb/s In 0.04 Mb/s Out - 121.0 p/s In 47.3 p/s Out
eth1: 1.06 Mb/s In 0.04 Mb/s Out - 123.9 p/s In 50.5 p/s Out
total: 288.21 Mb/s In 1.37 Mb/s Out - 24193.5 p/s In 2389.0 p/s Out
eth0: 152.06 Mb/s In 0.67 Mb/s Out - 12790.5 p/s In 1154.3 p/s Out
eth1: 136.15 Mb/s In 0.70 Mb/s Out - 11403.0 p/s In 1234.7 p/s Out
total: 1307.89 Mb/s In 6.22 Mb/s Out - 110060.5 p/s In 10903.6 p/s Out
eth0: 666.02 Mb/s In 2.97 Mb/s Out - 56061.4 p/s In 5172.4 p/s Out
eth1: 641.87 Mb/s In 3.25 Mb/s Out - 53999.1 p/s In 5731.2 p/s Out
total: 1286.38 Mb/s In 6.15 Mb/s Out - 108248.9 p/s In 10771.6 p/s Out
eth0: 642.20 Mb/s In 2.88 Mb/s Out - 54058.7 p/s In 5011.2 p/s Out
eth1: 644.18 Mb/s In 3.27 Mb/s Out - 54190.2 p/s In 5760.4 p/s Out
total: 1294.30 Mb/s In 6.19 Mb/s Out - 108921.4 p/s In 10854.0 p/s Out
eth0: 648.03 Mb/s In 2.92 Mb/s Out - 54556.0 p/s In 5089.5 p/s Out
eth1: 646.27 Mb/s In 3.27 Mb/s Out - 54365.4 p/s In 5764.5 p/s Out
total: 631.95 Mb/s In 3.05 Mb/s Out - 53211.1 p/s In 5316.6 p/s Out
eth0: 296.08 Mb/s In 1.34 Mb/s Out - 24938.3 p/s In 2310.2 p/s Out
eth1: 335.87 Mb/s In 1.71 Mb/s Out - 28272.8 p/s In 3006.4 p/s Out
FC target configuration - Targetcli as open source SAN (debian)
Installation on debian wheezy with kernel 3.10.25
Download rpm
apt-get install targetcli
Or install without recommended packages
apt-get install --no-install-recommends targetcli
Create file for datastore
dd if=/dev/zero of=/opt/test1 bs=1024 count=6000000
targetcli
Create datastore on targetcli
cd backstores/fileio
create itest1 /opt/test1 6144000000B
Create iSCSCI target instance
cd /iscsi
create
Map LUN to datastore (based on FILEIO)
cd luns
create /backstores/fileio/itest1
Configure ACL (check WWN in openiscsi section)
cd ../../acls
create
create iqn.1993-08.org.debian:01:dcb3d359cc91
Save configuration
cd /
saveconfig
Disable athentication
cd iscsi/
set set discovery_auth enable=0
cd /iscsi/iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.8b4b5e8c13a2/tpgt1
set attribute authentication=0
Configure interface
cd portals
create
cd /
saveconfig
All config should looks like:
targetcli
ls
o- / ......................................................................................................... [...]
o- backstores .............................................................................................. [...]
| o- fileio ................................................................................... [1 Storage Object]
| | o- idisk ............................................................................. [/opt/test1 activated]
| o- iblock ................................................................................... [0 Storage Object]
| o- pscsi .................................................................................... [0 Storage Object]
| o- rd_dr .................................................................................... [0 Storage Object]
| o- rd_mcp ................................................................................... [0 Storage Object]
o- iscsi .............................................................................................. [1 Target]
| o- iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.8b4b5e8c13a2 ........................................ [1 TPG]
| o- tpgt1 ........................................................................................... [enabled]
| o- acls ........................................................................................... [1 ACLs]
| | o- iqn.1993-08.org.debian:01:dcb3d359cc91 ................................................. [1 Mapped LUN]
| | o- mapped_lun0 ............................................................................. [lun0 (rw)]
| o- luns ............................................................................................ [1 LUN]
| | o- lun0 ..................................................................... [fileio/idisk (/home/test1)]
| o- portals ...................................................................................... [1 Portal]
| o- 192.168.42.135:3260 .............................................................................. [OK]
o- loopback ........................................................................................... [0 Target]
o- qla2xxx ............................................................................................ [0 Target]
o- tcm_fc ............................................................................................. [0 Target]
OpeniSCSI installation - client (initiatior)
aptitude install open-iscsi
/etc/init.d/open-iscsi restart
Search target name:
iscsiadm -m discovery -t sendtargets -p 192.168.42.135
Check your initiator name
cat /etc/iscsi/initiatorname.iscsi
## DO NOT EDIT OR REMOVE THIS FILE!
## If you remove this file, the iSCSI daemon will not start.
## If you change the InitiatorName, existing access control lists
## may reject this initiator. The InitiatorName must be unique
## for each iSCSI initiator. Do NOT duplicate iSCSI InitiatorNames.
InitiatorName=iqn.1993-08.org.debian:01:dcb3d359cc91
iscsiadm -m node
Connect to iscsi target:
iscsiadm -m node --targetname "iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.8b4b5e8c13a2" --portal "192.168.42.135:3260" --login
Verify new block device
dmesg | tail
Download rpm
apt-get install targetcli
Or install without recommended packages
apt-get install --no-install-recommends targetcli
Create file for datastore
dd if=/dev/zero of=/opt/test1 bs=1024 count=6000000
targetcli
Create datastore on targetcli
cd backstores/fileio
create itest1 /opt/test1 6144000000B
Create iSCSCI target instance
cd /iscsi
create
Map LUN to datastore (based on FILEIO)
cd luns
create /backstores/fileio/itest1
Configure ACL (check WWN in openiscsi section)
cd ../../acls
create
create iqn.1993-08.org.debian:01:dcb3d359cc91
Save configuration
cd /
saveconfig
Disable athentication
cd iscsi/
set set discovery_auth enable=0
cd /iscsi/iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.8b4b5e8c13a2/tpgt1
set attribute authentication=0
Configure interface
cd portals
create
cd /
saveconfig
All config should looks like:
targetcli
ls
o- / ......................................................................................................... [...]
o- backstores .............................................................................................. [...]
| o- fileio ................................................................................... [1 Storage Object]
| | o- idisk ............................................................................. [/opt/test1 activated]
| o- iblock ................................................................................... [0 Storage Object]
| o- pscsi .................................................................................... [0 Storage Object]
| o- rd_dr .................................................................................... [0 Storage Object]
| o- rd_mcp ................................................................................... [0 Storage Object]
o- iscsi .............................................................................................. [1 Target]
| o- iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.8b4b5e8c13a2 ........................................ [1 TPG]
| o- tpgt1 ........................................................................................... [enabled]
| o- acls ........................................................................................... [1 ACLs]
| | o- iqn.1993-08.org.debian:01:dcb3d359cc91 ................................................. [1 Mapped LUN]
| | o- mapped_lun0 ............................................................................. [lun0 (rw)]
| o- luns ............................................................................................ [1 LUN]
| | o- lun0 ..................................................................... [fileio/idisk (/home/test1)]
| o- portals ...................................................................................... [1 Portal]
| o- 192.168.42.135:3260 .............................................................................. [OK]
o- loopback ........................................................................................... [0 Target]
o- qla2xxx ............................................................................................ [0 Target]
o- tcm_fc ............................................................................................. [0 Target]
OpeniSCSI installation - client (initiatior)
aptitude install open-iscsi
/etc/init.d/open-iscsi restart
Search target name:
iscsiadm -m discovery -t sendtargets -p 192.168.42.135
Check your initiator name
cat /etc/iscsi/initiatorname.iscsi
## DO NOT EDIT OR REMOVE THIS FILE!
## If you remove this file, the iSCSI daemon will not start.
## If you change the InitiatorName, existing access control lists
## may reject this initiator. The InitiatorName must be unique
## for each iSCSI initiator. Do NOT duplicate iSCSI InitiatorNames.
InitiatorName=iqn.1993-08.org.debian:01:dcb3d359cc91
iscsiadm -m node
Connect to iscsi target:
iscsiadm -m node --targetname "iqn.2003-01.org.linux-iscsi.sc-azl-001.x8664:sn.8b4b5e8c13a2" --portal "192.168.42.135:3260" --login
Verify new block device
dmesg | tail
Debian wheezy kernel upgrade to 3.10 installation
Install packages needed to compile:
apt-get install fakeroot build-essential ncurses-dev
Download and unpack kernel
wget https://www.kernel.org/pub/linux/kernel/v3.x/linux-3.10.25.tar.bz2
tar -xvf linux-3.10.25.tar.bz2
cd linux-3.10.25/
Configure kernel base on old configuration
cat /boot/config-`uname -r` > .config
cat .config
make oldconfig
make menuconfig
Compile kernel
time make deb-pkg -j2
Install
dpkg -i ../linux-firmware-image_3.10.25-1_amd64.deb ../linux-headers-3.10.25_3.10.25-1_amd64.deb ../linux-libc-dev_3.10.25-1_amd64.deb ../linux-image-3.10.25_3.10.25-1_amd64.deb
apt-cache policy linux-libc-dev
restart debian
apt-get install fakeroot build-essential ncurses-dev
Download and unpack kernel
wget https://www.kernel.org/pub/linux/kernel/v3.x/linux-3.10.25.tar.bz2
tar -xvf linux-3.10.25.tar.bz2
cd linux-3.10.25/
Configure kernel base on old configuration
cat /boot/config-`uname -r` > .config
cat .config
make oldconfig
make menuconfig
Compile kernel
time make deb-pkg -j2
Install
dpkg -i ../linux-firmware-image_3.10.25-1_amd64.deb ../linux-headers-3.10.25_3.10.25-1_amd64.deb ../linux-libc-dev_3.10.25-1_amd64.deb ../linux-image-3.10.25_3.10.25-1_amd64.deb
apt-cache policy linux-libc-dev
restart debian
Subscribe to:
Posts (Atom)