ispmail-workaround-org/src/content/docs/ispmail-bookworm/90-prepare-database.mdx

219 lines
11 KiB
Text
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

---
title: Preparing the database
lastUpdated: 2023-10-03
slug: ispmail-bookworm/prepare-the-database
sidebar:
order: 90
---
import { Aside } from "@astrojs/starlight/components";
import { Tabs, TabItem } from '@astrojs/starlight/components';
Now its time to prepare the MariaDB database that stores the information that controls your mail server. In the process you will have to enter [SQL](http://en.wikipedia.org/wiki/SQL) queries the language of relational database servers. You may enter them in a terminal window using the mysql command. But if you are less experienced with SQL you may prefer using a web interface. Thats what you installed _[Adminer](https://www.adminer.org/)_ for.
<Aside type="tip" title="Why not PostgreSQL?">
Several comments show that some system administrators prefer the PostgreSQL database engine over MariaDB. Count me in. So why is this guide still using MariaDB/MySQL? Mainly for historical reasons. I want to spare you any unneccessary changes when migrating to a new version. If you are familiar with PostgreSQL however you can easily adapt this guide to PostgreSQL. There are dovecot-pgsql and postfix-pgsql packages. And Adminer works with PostgreSQL as well.
It may be worth using SQLite instead. Because on small _family-and-friends_ servers that would be totally sufficient. Let us see if it will be added to this guide at a later time.
</Aside>
## Setting up Adminer
Basically Adminer is just a couple of PHP files served from your Apache web server. The setup is simple. Edit your /etc/apache2/sites-available/**webmail.example.org**-https.conf file and put this line anywhere between the &lt;VirtualHost&gt; and the &lt;/VirtualHost&gt; tags:
```
Alias /adminer /usr/share/adminer/adminer
```
Reload the Apache process:
```
systemctl reload apache2
```
<Aside type="danger" title="Security warning">
Having an SQL admin interface publicly available on your web site is an invitation for internet scoundrels to do bad things. Consider protecting the /adminer location by an additional password. The Apache documentation shows you how to do that. Or use a less obvious path than “/adminer” in the Alias.
</Aside>
You will not be able to login yet. The only available database user is root, but it is only usable from the shell by default not over a network.
## Generate two random passwords
In this section you will create the basic database “mailserver” and two users. One user (“mailadmin”) will be able to change the data in the database and is meant for you. The other user (“mailserver”) can only read from the database and is meant for the server processes.
Use the _pwgen_ tool to create two random passwords for these users:
```
pwgen -s1 30 2
```
Take a note of the passwords or store them somewhere safe.
## Create the mailserver database
This step is simple. Connect to the database using the mysql command:
```
mysql
```
You should see the MariaDB prompt that allows you to enter further SQL commands:
```
MariaDB [(none)]>
```
Now you are expected to speak SQL. To create a new database for our needs enter:
```
CREATE DATABASE mailserver;
```
You will be told that your query was OK and that one new row was added.
## Create the database users
Now you have an empty database. Let us give the “mailadmin” database user the required privileges to manage it.
You are still connected to the database, right? To create a user with full permissions enter this SQL command. Please use the **first** password you just generated instead of mine:
```
grant all privileges on mailserver.* to 'mailadmin'@'localhost' identified by 'gefk6lA2brMOeb8eR5WYaMEdKDQfnF';
```
Also create the read-only user that will grant Postfix and Dovecot database access later (use your **second** random password here).
```
grant select on mailserver.* to 'mailserver'@'127.0.0.1' identified by 'x893dNj4stkHy1MKQq0USWBaX4ZZdq';
```
<Aside type="note" title="127.0.0.1 versus localhost">
Wait a minute. Why is there “127.0.0.1” instead of “localhost” in the second SQL command? Is that a typo? No, its not. Well, in network terminology those two are identical. But MariaDB (and Oracles MySQL) distinguishes between the two. If you initiate a database connection to “localhost” then you talk to the socket file which lives at /var/run/mysqld/mysqld.sock on your server. But if you connect to “127.0.0.1” it will create a network connection talking to the TCP socket on port 3306 on your server. The difference is that any process on your server can talk to 127.0.0.1. But the socket file has certain user/group/other permissions just like any other file on your file system. Postfix will be restricted to its /var/spool/postfix directory and cannot by default access that socket file. So by using 127.0.0.1 we circumvent that limitation.
When you use _Adminer_ you will have to use localhost as a database server when using the mailadmin user but 127.0.0.1 when using the mailserver user.
</Aside>
Now you can use _Adminer_ to log in using the _mailadmin_ account and the **first** password:
![Login to Adminer](images/prepare-database-adminer-login.png)
You should get logged in and see the “mailserver” database:
![Create a database in Adminer](images/prepare-database-adminer-mailserver-database.png)
## Creating the database tables
Do you remember that I introduced three Postfix _mappings_ earlier? One for _virtual domains_, one for _virtual aliases_ and another for _virtual users_? Each of the mappings needs a database table that you will create now. Feel free to use _Adminer_. I will however also show the SQL statement to create the tables that you can enter on the mysql command-line tool. Below you can click on either \[Adminer\] or \[SQL\] to choose.
The first table to create is…
## virtual\_domains
This table just holds the list of domains that you will use as _virtual\_mailbox\_domains_ in Postfix.
<Tabs syncKey="sql">
<TabItem label="Adminer">
| **Column** | **Purpose** |
| ---------- | -------------------------------------------------------------------------------- |
| id | A unique number identifying each row. It is added by the database automatically. |
| name | The name of the domain you want to receive email for. |
</TabItem>
<TabItem label="SQL">
```sql
USE mailserver;
CREATE TABLE IF NOT EXISTS `virtual_domains` (
`id` int(11) NOT NULL auto_increment,
`name` varchar(50) NOT NULL,
PRIMARY KEY (`id`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;
```
</TabItem>
</Tabs>
### virtual\_users
The next table contains information about your users. Each mail account takes up one row.
<Tabs syncKey="sql">
<TabItem label="Adminer">
| **Column** | **Purpose**|
| ---------- | --- |
| domain\_id | Contains the number of the domains id in the _virtual\_domains_ table. This is called a _[foreign key](https://en.wikipedia.org/wiki/Foreign_key)_. A “delete cascade” makes sure that if a domain is deleted that all user accounts in that domain are also deleted to avoid orphaned rows. |
| email | The email address of the mail account.|
| password | The hashed password of the mail account. It is prepended by the [password scheme](https://doc.dovecot.org/configuration_manual/authentication/password_schemes/). By [default](https://doc.dovecot.org/configuration_manual/authentication/password_schemes/) it is `{BLF-CRYPT}` also known as _bcrypt_ which is considered very secure. Previous ISPmail guides used `{SHA256-CRYPT}` or even older crypt schemes. Prepending the password field the hashing algorithm in curly brackets allows you to have different kinds of hashes. So you can easily migrate your old passwords without locking out users. Users with older schemes should get a new password if possible to increase security. |
| quota | The number of bytes that this mailbox can store. You can use this value to limit how much space a mailbox can take up. The default value is 0 which means that there is no limit. |
</TabItem>
<TabItem label="SQL">
```sql
CREATE TABLE IF NOT EXISTS `virtual_users` (
`id` int(11) NOT NULL auto_increment,
`domain_id` int(11) NOT NULL,
`email` varchar(100) NOT NULL,
`password` varchar(150) NOT NULL,
`quota` bigint(11) NOT NULL DEFAULT 0,
PRIMARY KEY (`id`),
UNIQUE KEY `email` (`email`),
FOREIGN KEY (domain_id) REFERENCES virtual_domains(id) ON DELETE CASCADE
) ENGINE=InnoDB DEFAULT CHARSET=utf8;
```
</TabItem>
</Tabs>
### virtual\_aliases
The last table contains forwardings from an email address to other email addresses.
<Tabs syncKey="sql">
<TabItem label="Adminer">
| **Field** | **Purpose** |
| --- | --- |
| id | A unique number identifying each row. It is added by the database automatically. |
| domain\_id | Contains the number of the domains id in the virtual\_domains table again. |
| source | The email address that the email was actually sent to. In case of catch-all addresses (that accept any address in a domain) the source looks like “@example.org”. |
| destination | The email address that the email should instead be sent to. |
</TabItem>
<TabItem label="SQL">
```sql
CREATE TABLE IF NOT EXISTS `virtual_aliases` (
`id` int(11) NOT NULL auto_increment,
`domain_id` int(11) NOT NULL,
`source` varchar(100) NOT NULL,
`destination` varchar(100) NOT NULL,
PRIMARY KEY (`id`),
FOREIGN KEY (domain_id) REFERENCES virtual_domains(id) ON DELETE CASCADE
) ENGINE=InnoDB DEFAULT CHARSET=utf8;
```
</TabItem>
</Tabs>
As described in the section about domain types there can be multiple targets for one source email address. You just would need to insert several rows with the same source address and different destination addresses that will get copies of an email. Postfix will consider all matching rows.
## Example data to play with
Too much theory so far? I can imagine. Lets populate the database with an `example.org` domain, a `john@example.org` email account and a forwarding of `jack@example.org` to `john@example.org`. We will use that information in the next chapter to play with.
To add that sample data just run these SQL queries:
```sql
REPLACE INTO mailserver.virtual\_domains (id,name) VALUES ('1','example.org');
REPLACE INTO mailserver.virtual\_users (id,domain\_id,password,email)
VALUES ('1', '1',
'{BLF-CRYPT}$2y$05$.WedBCNZiwxY1CG3aleIleu6lYjup2CIg0BP4M4YCZsO204Czz07W',
'john@example.org');
REPLACE INTO mailserver.virtual\_aliases (id,domain\_id,source,destination)
VALUES ('1', '1', 'jack@example.org', 'john@example.org');
```
Do you wonder how I got the long cryptic password? I ran…
```
doveadm pw -s BLF-CRYPT
```
…to create a secure hash of the simple password “summersun”. Once you have installed Dovecot you can try that yourself but you will get a different output. The reason is that the passwords are [salted](https://en.wikipedia.org/wiki/Salt_\(cryptography\)) to increase their security.
Remember to remove that sample data before you go live with your mail server. Thanks to the _delete cascade_ you just need to remove the virtual\_domain. The alias and the mailbox will be deleted automatically. This would be the SQL query you should run before taking your mail server into production:
```sql
DELETE FROM mailserver.virtual_domains WHERE name='example.org';
```