Quobyte - Revision history

Mariusz: Add link to the update prcedure

2020-09-30T14:38:30Z

Add link to the update prcedure

David: /* Setup the s3 proxy and access via s3cmd */

2019-01-11T13:57:50Z

Setup the s3 proxy and access via s3cmd

David at 13:53, 11 January 2019

2019-01-11T13:53:35Z

David: /* Download the Quobyte yum repo file */

2018-05-11T15:58:23Z

Download the Quobyte yum repo file

Patrick at 16:54, 1 March 2018

2018-03-01T16:54:24Z

Patrick at 16:48, 1 March 2018

2018-03-01T16:48:59Z

Patrick at 16:30, 1 March 2018

2018-03-01T16:30:30Z

Patrick at 16:27, 1 March 2018

2018-03-01T16:27:27Z

Patrick at 15:49, 1 March 2018

2018-03-01T15:49:54Z

Patrick at 15:12, 1 March 2018

2018-03-01T15:12:37Z

← Older revision		Revision as of 14:38, 30 September 2020
Line 425:		Line 425:
	0 of 0 0% in 0s 0.00 B/s done		0 of 0 0% in 0s 0.00 B/s done
	</syntaxhighlight>		</syntaxhighlight>
		+
		+	= Update procedure =
		+	https://support.quobyte.com/docs/3/latest/runbook_duties.html#updating

@@ Line 400: / Line 400: @@
    Default Region: US
    S3 Endpoint: storage001:8118
-   DNS-style bucket+hostname:port template for accessing a bucket: %(bucket)s.storage001:8118
+   DNS-style bucket+hostname:port template for accessing a bucket: storage001:8118
    Encryption password:
    Path to GPG program: /usr/bin/gpg
@@ Line 406: / Line 406: @@
    HTTP Proxy server name:
    HTTP Proxy server port: 0
 </syntaxhighlight>

@@ Line 332: / Line 332: @@
 mount.quobyte q01:7861,q02:7861,q03:7861,q04:7861/scratch_vol /scratch
 mount.quobyte q01:7861,q02:7861,q03:7861,q04:7861/archive_vol /archive
 </syntaxhighlight>

@@ Line 18: / Line 18: @@
 cd /etc/yum.repos.d
 wget https://packages.quobyte.com/repo/9/<YOUR_REPO_ID>/rpm/CentOS_7/quobyte.repo
 </syntaxhighlight>

@@ Line 1: / Line 1: @@
-[[File:Quobyte.png|200px]]
+[[File:Quobyte.png|centre|250px]]
 =Server Installation=
@@ Line 5: / Line 5: @@
 Before installing Quobyte server software there are some tasks that need to be performed on each server to ensure correct functionality.
-====Configure NTP====
+===Configure NTP===
 Each server needs to have the same time, or some services will not start. Ensure that NTP is configured and running on all servers, and check all clocks are synced.
-====Disable Swap====
+===Disable Swap===
 Disable swap on each storage server. Running <code>swapoff -a</code> will disable all swap devices found in /proc/swaps and /etc/fstab. Also comment out/remove any swap lines in /etc/fstab to prevent swap being activated if a server is rebooted.
-====Install dependencies====
+===Install dependencies===
 <syntaxhighlight>yum -y install java-1.8.0-openjdk-headless wget</syntaxhighlight>
-====Download the Quobyte yum repo file====
+===Download the Quobyte yum repo file===
 <syntaxhighlight>
 cd /etc/yum.repos.d
@@ Line 20: / Line 20: @@
 </syntaxhighlight>
-====Install Quobyte packages====
+===Install Quobyte packages===
 <syntaxhighlight>yum -y install quobyte-server quobyte-client</syntaxhighlight>
 =Server Configuration=
-====Prepare Drives====
+===Prepare Drives===
 Any drives being used by Quobyte need to be formatted and mounted before Quobyte can use them. Currently only ext4 and XFS are supported.
@@ Line 52: / Line 52: @@
 </syntaxhighlight>
-====Define Registry Servers====
+===Define Registry Servers===
 Edit /etc/quobyte/host.cfg on each server to state which servers are running the registry servers. In our setup all 4 are so it was updated to read
@@ Line 59: / Line 59: @@
 If name resolution isn't configured on the servers the hostnames can be replaced with IP addresses.
-====Create registry devices====
+===Create registry devices===
 To create the first registry device do the following on one server only.
@@ Line 101: / Line 101: @@
 </syntaxhighlight>
-====Add Metadata Devices====
+===Add Metadata Devices===
 From the first server run the following command to add Metadata to the registry devices
@@ Line 125: / Line 125: @@
 </syntaxhighlight>
-====Add Data Devices====
+===Add Data Devices===
 To add data devices perform the following on each server.

← Older revision		Revision as of 16:48, 1 March 2018
Line 297:		Line 297:

	[[File:quobyte_add_subconfig.png\|551px]]		[[File:quobyte_add_subconfig.png\|551px]]
		+
		+	===Creating Volumes===
		+
		+	Volumes are created either from the CLI or through the web console.
		+
		+	* CLI
		+	The generic command used to create volumes is
		+	<syntaxhighlight>qmgmt volume create <volume name> <user> <group> <volume configuration></syntaxhighlight>
		+
		+	In the test bed 3 volumes were created using different volume configurations. They were created by running the following commands
		+
		+	<syntaxhighlight>
		+	qmgmt volume create home_vol root root 3x_replication
		+	qmgmt volume create scratch_vol root root ssd_performance
		+	qmgmt volume create archive_vol root root 8+3_erasure
		+	</syntaxhighlight>
		+
		+	===Mounting Volumes===
		+
		+	Volumes can be mounted on any server that the quobyte-client package is installed. There is a CLI tool mount.quobyte used to mount the quobyte volumes.
		+	The command takes a list of registry servers and volume to mount as well as the directory to mount the volume to. So to mount the home_vol above to /home
		+
		+	<syntaxhighlight>
		+	mount.quobyte q01:7861,q02:7861,q03:7861,q04:7861/home_vol /home
		+	</syntaxhighlight>
		+
		+	This can be repeated to mount any other volumes
		+
		+	<syntaxhighlight>
		+	mount.quobyte q01:7861,q02:7861,q03:7861,q04:7861/scratch_vol /scratch
		+	mount.quobyte q01:7861,q02:7861,q03:7861,q04:7861/archive_vol /archive
		+	</syntaxhighlight>

← Older revision		Revision as of 16:30, 1 March 2018
Line 296:		Line 296:
	The Web console only allows new sub-configurations to be created, i.e configurations that inherit from another. To create a new sub-configuration, navigate to 'Volume Configurations' and tick the box next to BASE. Then from the drop down menu select 'Add new sub-configuration'		The Web console only allows new sub-configurations to be created, i.e configurations that inherit from another. To create a new sub-configuration, navigate to 'Volume Configurations' and tick the box next to BASE. Then from the drop down menu select 'Add new sub-configuration'

−	[[File:quobyte_add_subconfig.png]]	+	[[File:quobyte_add_subconfig.png\|551px]]

← Older revision		Revision as of 16:27, 1 March 2018
Line 290:		Line 290:
	</syntaxhighlight>		</syntaxhighlight>

−	This will create 3 replications of data and metadata, as well as only place data on devices tagged with "hdd". The use of tags allows for finer control of what data is ~~plcaed~~ on what devices. In this example all data is placed on HDDs and not on SSD storage.	+	This will create 3 replications of data and metadata, as well as only place data on devices tagged with "hdd". The use of tags allows for finer control of what data is placed on what devices. In this example all data is placed on HDDs and not on SSD storage.
		+
		+	* Web console
		+
		+	The Web console only allows new sub-configurations to be created, i.e configurations that inherit from another. To create a new sub-configuration, navigate to 'Volume Configurations' and tick the box next to BASE. Then from the drop down menu select 'Add new sub-configuration'
		+
		+	[[File:quobyte_add_subconfig.png]]

@@ Line 162: / Line 162: @@
 ===Viewing Volume Configurations===
-Configurations can be viewed through the API or from the webconsole.
+Configurations can be viewed through the API or from the web console.
 * API
@@ Line 228: / Line 228: @@
-* Webconsole
+* Web console
-Login to webconsole and navigate to "Volume Configuration". Select BASE to view the configuration.
+Login to web console and navigate to "Volume Configuration". Select BASE to view the configuration.
 [[File:Quobyte base vol config webconsole.png|551px]]
@@ Line 244: / Line 244: @@
 This will open in your default editor (or use the value of the EDITOR environment variable if it is set).
-* Webconsole
+* Web console
 Navigate to 'Volume Configurations' and tick the box beside BASE. Then select 'edit' from the drop down menu.
@@ Line 251: / Line 251: @@
 ===Creating Volume Configurations===

← Older revision		Revision as of 15:12, 1 March 2018
Line 247:		Line 247:

	Navigate to 'Volume Configurations' and tick the box beside BASE. Then select 'edit' from the drop down menu.		Navigate to 'Volume Configurations' and tick the box beside BASE. Then select 'edit' from the drop down menu.
		+
		+	[[file:quobyte_edit_base_config.png\|551px]]

	===Creating Volume Configurations===		===Creating Volume Configurations===