2017-01-25

These configuration parameters are specified in YAML format in your config.yaml file. During DC/OS installation the configuration file is used to generate a customized DC/OS build.

Cluster Setup

agent_list

This parameter specifies a YAML nested list (-) of IPv4 addresses to your agent host names.

bootstrap_url

This required parameter specifies the URI path for the DC/OS installer to store the customized DC/OS build files. If you are using the automated DC/OS installer, you should specify bootstrap_url: file:///opt/dcos_install_tmp unless you have moved the installer assets. By default the automated DC/OS installer places the build files in file:///opt/dcos_install_tmp.

cluster_name

This parameter specifies the name of your cluster.

exhibitor_storage_backend

This parameter specifies the type of storage backend to use for Exhibitor. You can use internal DC/OS storage (static) or specify an external storage system (zookeeper, aws_s3, azure, and shared_filesystem) for configuring and orchestrating Zookeeper with Exhibitor on the master nodes. Exhibitor automatically configures your Zookeeper installation on the master nodes during your DC/OS installation.

exhibitor_storage_backend: static This option specifies that the Exhibitor storage backend is managed internally within your cluster. This is the default value.

exhibitor_storage_backend: zookeeper This option specifies a ZooKeeper instance for shared storage. If you use a ZooKeeper instance to bootstrap Exhibitor, this ZooKeeper instance must be separate from your DC/OS cluster. You must have at least 3 ZooKeeper instances running at all times for high availability. If you specify zookeeper, you must also specify these parameters.

exhibitor_zk_hosts This parameter specifies a comma-separated list (<ZK_IP>:<ZK_PORT>, <ZK_IP>:<ZK_PORT>, <ZK_IP:ZK_PORT>) of one or more ZooKeeper node IP and port addresses to use for configuring the internal Exhibitor instances. Exhibitor uses this ZooKeeper cluster to orchestrate it’s configuration. Multiple ZooKeeper instances are recommended for failover in production environments.

exhibitor_zk_path This parameter specifies the filepath that Exhibitor uses to store data.

exhibitor_storage_backend: aws_s3 This option specifies an Amazon Simple Storage Service (S3) bucket for shared storage. If you specify aws_s3, you must also specify these parameters.

aws_access_key_id This parameter specifies AWS key ID.

aws_region This parameter specifies AWS region for your S3 bucket.

aws_secret_access_key This parameter specifies AWS secret access key.

exhibitor_explicit_keys This parameter specifies whether you are using AWS API keys to grant Exhibitor access to S3.

exhibitor_explicit_keys: 'true' If you’re using AWS API keys to manually grant Exhibitor access.

exhibitor_explicit_keys: 'false' If you’re using AWS Identity and Access Management (IAM) to grant Exhibitor access to S3.

s3_bucket This parameter specifies name of your S3 bucket.

s3_prefix This parameter specifies S3 prefix to be used within your S3 bucket to be used by Exhibitor.

Tip: AWS EC2 Classic is not supported.

exhibitor_storage_backend: azure

This option specifies an Azure Storage Account for shared storage. The data will be stored under the container named dcos-exhibitor. If you specify azure, you must also specify these parameters:

exhibitor_azure_account_name

This parameter specifies the Azure Storage Account Name.

exhibitor_azure_account_key

This parameter specifies a secret key to access the Azure Storage Account.

exhibitor_azure_prefix

This parameter specifies the blob prefix to be used within your Storage Account to be used by Exhibitor.

exhibitor_storage_backend: shared_filesystem This option specifies a Network File System (NFS) mount for shared storage. If you specify shared_filesystem, you must also specify this parameter:

exhibitor_fs_config_dir This parameter specifies the absolute path to the folder that Exhibitor uses to coordinate its configuration. This should be a directory inside of a Network File System (NFS) mount. For example, if every master has /fserv mounted via NFS, set as exhibitor_fs_config_dir: /fserv/dcos-exhibitor.

Important: With shared_filesystem, all masters must must have the NFS volume mounted and exhibitor_fs_config_dir must be inside of it. If any of your servers are missing the mount, the DC/OS cluster will not start.

master_discovery

This required parameter specifies the Mesos master discovery method. The available options are static or master_http_loadbalancer.

master_discovery: static This option specifies that Mesos agents are used to discover the masters by giving each agent a static list of master IPs. The masters must not change IP addresses, and if a master is replaced, the new master must take the old master’s IP address. If you specify static, you must also specify this parameter:

master_list This required parameter specifies a list of your static master IP addresses as a YAML nested series (-).

master_discovery: master_http_loadbalancer This option specifies that the set of masters has an HTTP load balancer in front of them. The agent nodes will know the address of the load balancer. They use the load balancer to access Exhibitor on the masters to get the full list of master IPs. If you specify master_http_load_balancer, you must also specify these parameters:

exhibitor_address This required parameter specifies the location (preferably an IP address) of the load balancer in front of the masters. The load balancer must accept traffic on ports 8080, 5050, 80, and 443; and forward it to the same ports on the master (for example, 8080 on lb -> 8080 on one master, 5050 on lb -> 5050 on one master). The master should forward any new connections via round robin, and should avoid machines that do not respond to requests on port 5050 to ensure the master is up.

num_masters This parameter specifies the number of Mesos masters in your DC/OS cluster. If master_discovery: static, do not use the num_masters parameter.

Note: On platforms like AWS where internal IPs are allocated dynamically, you should not use a static master list. If a master instance were to terminate for any reason, it could lead to cluster instability.

rexray_config_method

This parameter specifies the REX-Ray configuration method for enabling external persistent volumes in Marathon. REX-Ray is a storage orchestration engine. For more information, see the external persistent volumes documentation.

rexray_config_method: empty An empty REX-ray configuration. This is the default value.

aws A REX-Ray configuration that is set up for AWS EC2 (EBS) and AWS Identity and Access Management (IAM).

rexray_config_method: file Specify the path to a REX-Ray configuration file with rexray_config_filename.

rexray_config_filename The path of a REX-Ray configuration file. For example:

rexray_config_filename: genconf/rexray.yaml

Security and Authentication

auth_cookie_secure_flag

This parameter specifies whether to allow web browsers to send the DC/OS authentication cookie through a non-HTTPS connection.

auth_cookie_secure_flag: false Send the DC/OS authentication cookie through non-HTTPS connections. If you are accessing the DC/OS cluster through an HTTP connection, this is the required setting. This is the default value.

auth_cookie_secure_flag: true Require an HTTPS connection to send the DC/OS authentication cookie. If you are accessing the DC/OS cluster through only HTTPS connections, this is the recommended setting.

customer_key

This parameter specifies the Enterprise DC/OS customer key. Customer keys are delivered via email to the Authorized Support Contact.

This key is a 128-bit hyphen-delimited hexadecimal identifier used to distinguish an individual cluster. The customer key serves as the Universally Unique Identifier (UUID) for a given installation.

Customer keys look like this:

ssh_key_path

This parameter specifies the path to the installer uses to log into the target nodes. By default this is set to /genconf/ssh_key. This parameter should not be changed because /genconf is local to the container that is running the installer, and is a mounted volume.

ssh_port

This parameter specifies the port to SSH to, for example 22.

ssh_user

This parameter specifies the SSH username, for example centos.

superuser_password_hash

This required parameter specifies the hashed superuser password. The superuser_password_hash is generated by using the installer --hash-password flag. For more information, see Identity and Access Management.

superuser_username

This required parameter specifies the Admin username. For more information, see Identity and Access Management.

telemetry_enabled

This parameter specifies whether to enable sharing of anonymous data for your cluster.

telemetry_enabled: 'true' Enable anonymous data sharing. This is the default value.

telemetry_enabled: 'false' Disable anonymous data sharing.

If you’ve already installed your cluster and would like to disable this in-place, you can go through an upgrade
with the same parameter set.

Networking

dns_search

This parameter specifies a space-separated list of domains that are tried when an unqualified domain is entered (e.g. domain searches that do not contain ‘.’). The Linux implementation of /etc/resolv.conf restricts the maximum number of domains to 6 and the maximum number of characters the setting can have to 256. For more information, see man /etc/resolv.conf.

A search line with the specified contents is added to the /etc/resolv.conf file of every cluster host. search can do the same things as domain and is more extensible because multiple domains can be specified.

In this example, example.com has public website www.example.com and all of the hosts in the datacenter have fully qualified domain names that end with dc1.example.com. One of the hosts in your datacenter has the hostname foo.dc1.example.com. If dns_search is set to ‘dc1.example.com example.com’, then every DC/OS host which does a name lookup of foo will get the A record for foo.dc1.example.com. If a machine looks up www, first www.dc1.example.com would be checked, but it does not exist, so the search would try the next domain, lookup www.example.com, find an A record, and then return it.

master_dns_bindall

This parameter specifies whether the master DNS port is open. An open master DNS port listens publicly on the masters. If you are upgrading, set this parameter to true.

'master_dns_bindall': 'true' The master DNS port is open. This is the default value.

'master_dns_bindall': 'false' The master DNS port is closed.

resolvers

This required parameter specifies a YAML nested list (-) of DNS resolvers for your DC/OS cluster nodes. You can specify a maximum of 3 resolvers. Set this parameter to the most authoritative nameservers that you have.

If you want to resolve internal hostnames, set it to a nameserver that can resolve them.

If you do not have internal hostnames to resolve, you can set this to a public nameserver like Google or AWS. For example, you can specify the Google Public DNS IP addresses (IPv4):

If you do not have a DNS infrastructure and do not have access to internet DNS servers, you can specify resolvers: []. By specifying this setting, all requests to non-.mesos will return an error. For more information, see the Mesos-DNS documentation.

Caution: If you set the resolvers parameter incorrectly, you will permanently damage your configuration and have to reinstall DC/OS.

Performance and Tuning

docker_remove_delay

This parameter specifies the amount of time to wait before removing stale Docker images stored on the agent nodes and the Docker image generated by the installer. It is recommended that you accept the default value 1 hour.

gc_delay

This parameter specifies the maximum amount of time to wait before cleaning up the executor directories. It is recommended that you accept the default value of 2 days.

log_directory

This parameter specifies the path to the installer host logs from the SSH processes. By default this is set to /genconf/logs. In most cases this should not be changed because /genconf is local to the container that is running the installer, and is a mounted volume.

process_timeout

This parameter specifies the allowable amount of time, in seconds, for an action to begin after the process forks. This parameter is not the complete process time. The default value is 120 seconds.

Tip: If have a slower network environment, consider changing to process_timeout: 600.

Example Configurations

DC/OS cluster with 3 masters, 5 agents, static master list specified.

DC/OS cluster with 3 masters, an Exhibitor/Zookeeper shared filesystem storage backend, Internal DNS

DC/OS Cluster with 3 masters, an Exhibitor/Zookeeper backed by an AWS S3 bucket, AWS DNS, and a public agent node

DC/OS cluster with 3 masters, an Exhibitor/Zookeeper backed by Zookeeper, master_http_loadbalancer master discovery, public agent node, and Google DNS

The post Configuration parameters appeared first on Mesosphere DC/OS Documentation.

Show more