Scality: Setup the RS2 (REST) Connector - Revision history

David: /* Some s3 Commands */

2013-08-16T09:46:32Z

Some s3 Commands

David: /* Some s3 Commands */

2013-08-16T09:41:01Z

Some s3 Commands

David: /* Some s3 Commands */

2013-08-16T09:40:09Z

Some s3 Commands

David: /* Some s3 Commands */

2013-08-16T09:37:46Z

Some s3 Commands

David at 09:37, 16 August 2013

2013-08-16T09:37:17Z

David at 09:19, 16 August 2013

2013-08-16T09:19:08Z

David: /* Install s3cmd */

2013-08-15T13:32:11Z

Install s3cmd

David at 13:31, 15 August 2013

2013-08-15T13:31:45Z

David at 11:59, 15 August 2013

2013-08-15T11:59:36Z

David: Created page with " * Assuming RING is setup and function, otherwise get back to the previous steps! http://wiki.bostonlabs.co.uk/w/index.php/Filesystems:_Scality == Install the RS2 Connector =..."

2013-08-15T11:59:26Z

Created page with " * Assuming RING is setup and function, otherwise get back to the previous steps! http://wiki.bostonlabs.co.uk/w/index.php/Filesystems:_Scality == Install the RS2 Connector =..."

New page

* Assuming RING is setup and function, otherwise get back to the previous steps! http://wiki.bostonlabs.co.uk/w/index.php/Filesystems:_Scality

== Install the RS2 Connector ==
<syntaxhighlight>
yum install scality-rest-connector
</syntaxhighlight>

== Configure the RS2 Connector ==
<syntaxhighlight>
[root@blade2 scality]$ scality-rest-connector-config
Do you want to configure sagentd? If you answer no, default values will be used [y]:
Please, enter the prefix used to name nodes in the supervisor [blade2-c]:
Please, enter the IP address of this server for the supervisor [172.28.15.2]:
Please, enter the IP address of the supervisor [172.28.15.1]:
install new config
configuring usage of ssl
generating /etc/scality-rest-connector/connectors.conf
Starting connector: [ OK ]
</syntaxhighlight>

@@ Line 190: / Line 190: @@
 | List all object in all buckets ||	s3cmd la
 |-
-| Put file into bucket	|| s3cmd put FILE [FILE…] s3://BUCKET[/PREFIX] |
+| Put file into bucket	|| s3cmd put FILE [FILE…] s3://BUCKET[/PREFIX]
-Get file from bucket	s3cmd get s3://BUCKET/OBJECT LOCAL_FILE
+|-
-Delete file from bucket	s3cmd del s3://BUCKET/OBJECT
+| Get file from bucket ||	s3cmd get s3://BUCKET/OBJECT LOCAL_FILE
-Synchronize a directory tree to S3	s3cmd sync LOCAL_DIR s3://BUCKET[/PREFIX] or s3://BUCKET[/PREFIX] LOCAL_DIR
+|-
-Disk usage by buckets	s3cmd du [s3://BUCKET[/PREFIX]]
+| Delete file from bucket ||	s3cmd del s3://BUCKET/OBJECT
-Get various information about buckets or files	s3cmd info s3://BUCKET[/OBJECT]
+|-
-Copy object	s3cmd cp s3://BUCKET1/OBJECT1 s3://BUCKET2[/OBJECT2]
+| Synchronize a directory tree to S3 ||	s3cmd sync LOCAL_DIR s3://BUCKET[/PREFIX] or s3://BUCKET[/PREFIX] LOCAL_DIR
-Move object	s3cmd mv s3://BUCKET1/OBJECT1 s3://BUCKET2[/OBJECT2]
+|-
-Modify access control list for bucket or files	s3cmd setacl s3://BUCKET[/OBJECT]
+| Disk usage by buckets || 	s3cmd du [s3://BUCKET[/PREFIX]]
-Sign arbitrary string using the secret key	s3cmd sign STRING-TO-SIGN
+|-
-Fix invalid file names in a bucket	s3cmd fixbucket s3://BUCKET[/PREFIX]
+| Get various information about buckets or files ||	s3cmd info s3://BUCKET[/OBJECT]
-List CloudFront distribution points	s3cmd cflist
+|-
-Display CloudFront distribution point parameters	s3cmd cfinfo [cf://DIST_ID]
+| Copy object || 	s3cmd cp s3://BUCKET1/OBJECT1 s3://BUCKET2[/OBJECT2]
-Create CloudFront distribution point	s3cmd cfcreate s3://BUCKET
+|-
-Delete CloudFront distribution point	s3cmd cfdelete cf://DIST_ID
+| Move object ||	s3cmd mv s3://BUCKET1/OBJECT1 s3://BUCKET2[/OBJECT2]
-Change CloudFront distribution point parameters	s3cmd cfmodify cf://DIST_ID
+|-
 |}

@@ Line 182: / Line 182: @@
 | s3cmd command with parameters
 |-
-|Make bucket	|| s3cmd mb s3://BUCKET |
+|Make bucket	|| s3cmd mb s3://BUCKET
-| Remove bucket ||	s3cmd rb s3://BUCKET |
+|-
-| List objects or buckets ||	s3cmd ls [s3://BUCKET[/PREFIX]] |
+| Remove bucket ||	s3cmd rb s3://BUCKET
-| List all object in all buckets ||	s3cmd la |
+|-
 | Put file into bucket	|| s3cmd put FILE [FILE…] s3://BUCKET[/PREFIX] |
 Get file from bucket	s3cmd get s3://BUCKET/OBJECT LOCAL_FILE

@@ Line 182: / Line 182: @@
 | s3cmd command with parameters
 |-
-|Make bucket	|| s3cmd mb s3://BUCKET ||
+|Make bucket	|| s3cmd mb s3://BUCKET |
-| Remove bucket ||	s3cmd rb s3://BUCKET ||
+| Remove bucket ||	s3cmd rb s3://BUCKET |
-| List objects or buckets ||	s3cmd ls [s3://BUCKET[/PREFIX]] ||
+| List objects or buckets ||	s3cmd ls [s3://BUCKET[/PREFIX]] |
-| List all object in all buckets ||	s3cmd la ||
+| List all object in all buckets ||	s3cmd la |
-| Put file into bucket	|| s3cmd put FILE [FILE…] s3://BUCKET[/PREFIX] ||
+| Put file into bucket	|| s3cmd put FILE [FILE…] s3://BUCKET[/PREFIX] |
 Get file from bucket	s3cmd get s3://BUCKET/OBJECT LOCAL_FILE
 Delete file from bucket	s3cmd del s3://BUCKET/OBJECT

@@ Line 182: / Line 182: @@
 | s3cmd command with parameters
 |-
-|Make bucket	|| s3cmd mb s3://BUCKET
+|Make bucket	|| s3cmd mb s3://BUCKET ||
-| Remove bucket ||	s3cmd rb s3://BUCKET
+| Remove bucket ||	s3cmd rb s3://BUCKET ||
-| List objects or buckets ||	s3cmd ls [s3://BUCKET[/PREFIX]]
+| List objects or buckets ||	s3cmd ls [s3://BUCKET[/PREFIX]] ||
-| List all object in all buckets ||	s3cmd la
+| List all object in all buckets ||	s3cmd la ||
-| Put file into bucket	|| s3cmd put FILE [FILE…] s3://BUCKET[/PREFIX]
+| Put file into bucket	|| s3cmd put FILE [FILE…] s3://BUCKET[/PREFIX] ||
 Get file from bucket	s3cmd get s3://BUCKET/OBJECT LOCAL_FILE
 Delete file from bucket	s3cmd del s3://BUCKET/OBJECT

← Older revision		Revision as of 09:37, 16 August 2013
Line 176:		Line 176:
	* You can correct this via the web interface		* You can correct this via the web interface
	* Or by checking the output from <tt>ringsh -r demo accessor configGet \| grep localhost</tt>		* Or by checking the output from <tt>ringsh -r demo accessor configGet \| grep localhost</tt>
		+
		+	=== Some s3 Commands ===
		+	{\| class="wikitable"
		+	\|Action
		+	\| s3cmd command with parameters
		+	\|-
		+	\|Make bucket \|\| s3cmd mb s3://BUCKET
		+	\| Remove bucket \|\| s3cmd rb s3://BUCKET
		+	\| List objects or buckets \|\| s3cmd ls [s3://BUCKET[/PREFIX]]
		+	\| List all object in all buckets \|\| s3cmd la
		+	\| Put file into bucket \|\| s3cmd put FILE [FILE…] s3://BUCKET[/PREFIX]
		+	Get file from bucket s3cmd get s3://BUCKET/OBJECT LOCAL_FILE
		+	Delete file from bucket s3cmd del s3://BUCKET/OBJECT
		+	Synchronize a directory tree to S3 s3cmd sync LOCAL_DIR s3://BUCKET[/PREFIX] or s3://BUCKET[/PREFIX] LOCAL_DIR
		+	Disk usage by buckets s3cmd du [s3://BUCKET[/PREFIX]]
		+	Get various information about buckets or files s3cmd info s3://BUCKET[/OBJECT]
		+	Copy object s3cmd cp s3://BUCKET1/OBJECT1 s3://BUCKET2[/OBJECT2]
		+	Move object s3cmd mv s3://BUCKET1/OBJECT1 s3://BUCKET2[/OBJECT2]
		+	Modify access control list for bucket or files s3cmd setacl s3://BUCKET[/OBJECT]
		+	Sign arbitrary string using the secret key s3cmd sign STRING-TO-SIGN
		+	Fix invalid file names in a bucket s3cmd fixbucket s3://BUCKET[/PREFIX]
		+	List CloudFront distribution points s3cmd cflist
		+	Display CloudFront distribution point parameters s3cmd cfinfo [cf://DIST_ID]
		+	Create CloudFront distribution point s3cmd cfcreate s3://BUCKET
		+	Delete CloudFront distribution point s3cmd cfdelete cf://DIST_ID
		+	Change CloudFront distribution point parameters s3cmd cfmodify cf://DIST_ID
		+	\|}

← Older revision		Revision as of 09:19, 16 August 2013
Line 130:		Line 130:
	host_bucket = %(bucket)s.blade2		host_bucket = %(bucket)s.blade2
	</syntaxhighlight>		</syntaxhighlight>
		+
		+	Final version of the <tt>.s3cfg</tt> file
		+	<syntaxhighlight>
		+	[default]
		+	access_key = test
		+	bucket_location = US
		+	cloudfront_host = cloudfront.amazonaws.com
		+	cloudfront_resource = /2010-07-15/distribution
		+	default_mime_type = binary/octet-stream
		+	delete_removed = False
		+	dry_run = False
		+	encoding = UTF-8
		+	encrypt = False
		+	follow_symlinks = False
		+	force = False
		+	get_continue = False
		+	gpg_command = /usr/bin/gpg
		+	gpg_decrypt = %(gpg_command)s -d --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
		+	gpg_encrypt = %(gpg_command)s -c --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
		+	gpg_passphrase =
		+	guess_mime_type = True
		+	host_base = blade2
		+	host_bucket = %(bucket)s.blade2
		+	human_readable_sizes = False
		+	list_md5 = False
		+	log_target_prefix =
		+	preserve_attrs = True
		+	progress_meter = True
		+	proxy_host =
		+	proxy_port = 0
		+	recursive = False
		+	recv_chunk = 4096
		+	reduced_redundancy = False
		+	secret_key = secretkey
		+	send_chunk = 4096
		+	simpledb_host = sdb.amazonaws.com
		+	skip_existing = False
		+	socket_timeout = 300
		+	urlencoding_mode = normal
		+	use_https = False
		+	verbosity = WARNING
		+	</syntaxhighlight>
		+
		+	'''NOTE:''' Encountered a problem here as the RS2 connector was pointing to localhost instead instead of 'blade2'
		+	* You can correct this via the web interface
		+	* Or by checking the output from <tt>ringsh -r demo accessor configGet \| grep localhost</tt>

@@ Line 51: / Line 51: @@
 == Install s3cmd ==
 Before we set this up, we need add dnsmasq so *.blade2 get resolved correctly
-=== Install dnsmask
+=== Install dnsmask ===
    yum install dnsmasq

@@ Line 17: / Line 17: @@
 generating /etc/scality-rest-connector/connectors.conf
 Starting connector:                                        [  OK  ]
 </syntaxhighlight>

← Older revision		Revision as of 11:59, 15 August 2013
Line 1:		Line 1:
−	* Assuming RING is setup and function, otherwise get back to the previous steps! http://wiki.bostonlabs.co.uk/w/index.php/Filesystems:_Scality	+	* Assuming RING is setup and function, otherwise get back to the previous steps! http://wiki.bostonlabs.co.uk/w/index.php/Filesystems:_Scality

	== Install the RS2 Connector ==		== Install the RS2 Connector ==