Postgres reference
ConfigurationΒΆ
The full configuration options for the Postgres instance can be found in the application spec reference.
Database connnectionΒΆ
To connect your application to the database, use information from the environment variables below.
description | environment variable | example |
---|---|---|
ip | NAIS_DATABASE_MYAPP_MYDB_HOST |
100.10.1.0 |
port | NAIS_DATABASE_MYAPP_MYDB_PORT |
5432 |
database name | NAIS_DATABASE_MYAPP_MYDB_DATABASE |
.spec.gcp.sqlInstances[].databases[].name |
database user | NAIS_DATABASE_MYAPP_MYDB_USERNAME |
.spec.gcp.sqlInstances[].name |
database password | NAIS_DATABASE_MYAPP_MYDB_PASSWORD |
(randomly generated) |
database url with credentials | NAIS_DATABASE_MYAPP_MYDB_URL |
postgresql://username:password@100.10.1.0:5432/mydb?sslcert=... |
Below variables only available for instances with private IP | ||
jdbc url with credentials 1 | NAIS_DATABASE_MYAPP_MYDB_JDBC_URL |
jdbc:postgresql://100.10.1.0:5432/mydb?password=...&user=...&sslcert=... |
path to root cert | NAIS_DATABASE_MYAPP_MYDB_SSLROOTCERT |
/var/run/secrets/nais.io/sqlcertificate/root-cert.pem |
path to client cert | NAIS_DATABASE_MYAPP_MYDB_SSLCERT |
/var/run/secrets/nais.io/sqlcertificate/cert.pem |
path to client key | NAIS_DATABASE_MYAPP_MYDB_SSLKEY |
/var/run/secrets/nais.io/sqlcertificate/key.pem |
path to client key in DER format | NAIS_DATABASE_MYAPP_MYDB_SSLKEY_PK8 |
/var/run/secrets/nais.io/sqlcertificate/key.pk8 |
ssl mode | NAIS_DATABASE_MYAPP_MYDB_SSLMODE |
verify-ca |
Info
The application is the only application that can access the database instance. Other applications can not connect. It is not, for instance, possible to have two applications (e.g. producer and consumer) connecting directly to the database.
Naming conventionsΒΆ
The prefix NAIS_DATABASE_MYAPP_MYDB
is automatically generated from the instance name myapp
(defaults to application name) and mydb
(from database spec).
You can customize these environment variable names by setting .spec.gcp.sqlInstances[].databases[].envVarPrefix
.
For instance, setting this to DB
will give you DB_HOST
, DB_USERNAME
, etc. Note that changing or adding envVarPrefix
requires you to manually delete the google-sql-<MYAPP>
secret and SQLUser
with the same name as the application, see below.
If you have hyphens (-
) in your application name or database name, they will be converted to underscores (_
). E.g. my-awesome-app
= MY_AWESOME_APP
.
Info
Note that if you change your application name, database name or envVarPrefix, and then change it later, you have to manually reset database credentials.
Database flagsΒΆ
Warning
Use database flags with caution, they will alter the behaviour of your postgres instance.
Postgres in gcp supports setting database flags to alter the database instance performance and functionality, the flags available are listed here: Google Cloud SQL supported flags. This listing specifies what value types are expected, which ranges are allowed and if a restart is required.
Example of setting database flags:
...
kind: Application
metadata:
name: myapp
spec:
gcp:
sqlInstances:
- type: POSTGRES_14
tier: db-f1-micro
databases:
- name: mydb
flags:
- name: autovacuum_max_workers
value: "10" #integer in google spec, requires restart
- name: autovacuum
value: "on" #boolean in google spec
- name: autovacuum_analyze_scale_factor
value: "2" #float in google spec
Info
The value is always required to be a string in nais.yaml
.
Database max connectionsΒΆ
The default maximum number of connections is dependent on the memory size of the instance and can be configured with the max_connections
flag. The smallest instance size has a default of 25 maximum connections.
Default connection limits for different memory sizes can be found on Google Cloud SQL Configure database flags.
Info
The actual connection limit for your application may be lower than the configured value due some connections being reserved for superusers and other internal processes.
Database metricsΒΆ
Postgres instances automatically collect metrics that can be viewed in the following locations:
- Google Cloud Console, under the
Cloud SQL
section. - NAIS Console, under the
Postgres
section. - Grafana, using the
Google CLoud Monitoring
datasource.
A list of all avaialbe metrics can be found on Cloud SQL metrics.
Learn how to view Postgres metrics in the Google Cloud Console, Grafana, and NAIS Console
Query insightsΒΆ
Query insights are now enabled by default in GCP. This feature provides query overview and analysis. The data is available in the Google cloud console.
For further reading see Google Cloud SQL Query Insights
Info
Data is available for seven days, increasing this will incur extra cost.
Maintenance windowΒΆ
Google will automatically perform upgrades, fix bugs and apply security patches to prevent exploits. Your application should be able to handle occasional downtime as this maintenance is performed. Read more on maintenance windows. NAIS does not configure the maintenance window, but this can be set up in the application spec: nais.yaml
.
If you wish to be notified about upcoming maintenance, you can opt-in for this on the Communications page in the GCP console.
Automated backupΒΆ
The database is backed up nightly at 3 AM (GMT+1) by default, but can be overridden in nais.yaml
by setting spec.gcp.sqlInstances[].autoBackupTime
.
By default, seven backups will be kept. More info about Cloud SQL backups.
The backups can be found in the Google Cloud SQL instance dashboard.
Point-in-time recoveryΒΆ
Point-in-time recovery can be enabled by configuring this in the sql instance for your application spec. This feature allows you to recover your database to a specific point in time.
Info
This feature is not enabled by default. When enabled the Postgres instance will be restarted.
Warning
Use this feature with automatic storage increase enabled.
See application spec reference. For further reading see google Cloud SQL PIT recovery
Disaster backupΒΆ
In case of catastrophic failure in GCP we are running a daily complete backup of the postgresql databases in GCP to an on-prem location. This backup currently runs at 5 am. This is in addition to the regular backups in GCP.
Postgres versionΒΆ
The Postgres version can be configured in the application spec. The version is defined by the type
field in the nais.yaml
file.
The full list of supported versions can be found in the application spec reference.
Learn how to safely upgrade the Postgres version
Server sizeΒΆ
The server instance size can be configured in the application spec.
The instance size is defined by the tier
field in the nais.yaml
file.
Learn how to change the server instance tier
The tier can be set to one of the following values:
Tier | Description |
---|---|
db-f1-micro |
Shared CPU, 0.6 GB RAM, not covered by Cloud SQL SLA |
db-g1-small |
Shared CPU, 1.7 GB RAM, not covered by Cloud SQL SLA |
db-custom-1-3840 |
1 CPU, 3.75 GB RAM |
db-custom-2-5120 |
2 CPUs, 5 GB RAM |
db-custom-2-7680 |
2 CPUs, 7.5 GB RAM |
db-custom-4-15360 |
4 CPUs, 15 GB RAM |
db-custom-<CPU>-<RAM> |
Custom tier, see below |
The custom tiers can be customized to fit your application's requirements, following this format:
- Replace the
<CPU>
placeholder with the number of CPUs - Replace the
<RAM>
placeholder with the amount of memory.
When selecting the number of CPUs and amount of memory, there are some restrictions on the configuration you choose:
- CPU must be either 1 or an even number between 2 and 96.
- Memory must be:
- 0.9 to 6.5 GB per vCPU
- A multiple of 256 MB
- At least 3.75 GB (3840 MB)
-
jdbc url can be generated for instances without private IP by using nais-cli to rotate the password.Β β©