Building full image that's supposed to contain asterisk-chan-quectel #2

lee.miller · 2023-01-11T00:28:47Z

lee.miller commented

2023-01-11 00:28:47 +00:00

Hi!

You've got a toolchain for aarch64_cortex-a72_gcc-11.2.0_musl and a factory world in the container.

This builds a custom image with config changes in the config.extra (from your make image PACKAGES plus asterisk-chan-quectel), those .gz should appear in the out together with packages.

Hi! You've got a toolchain for `aarch64_cortex-a72_gcc-11.2.0_musl` and a factory world in the container. This builds a custom image with config changes in the `config.extra` (from your `make image` `PACKAGES` plus `asterisk-chan-quectel`), those .gz should appear in the out together with packages.

lee.miller added 16 commits 2023-01-11 00:28:47 +00:00

Try to build a single package: add feeds e3211fea16

Try moving toolchain installation into Dockerfile once again: 3def25a8a4

break the big make step into two. Try doing full make in build.sh.

Locate openwrt source 74cf65ebab

Debug make, save initial workdir a83a29f7d8

make download world 6f40e632fc

Change owner for /openwrt dir 8ce44bdd9a

Try to fix target 1fa6928348

Debug toolchain installation, make defconfig only 8aba0964a9

Adjust feeds again 5261192442

Try toolchain install and download world once again c6399d35c9

Try change also group b6b6e79935

Return to building as root 11aa3feadb

Make make verbose 99f8440a50

Fix package PKG_BUILD_DIR 01db6339a8

Try downloading and building a stock world in the container d6def5ce71

Only make world in build.sh with config changes, fix out path a12dd441ae

lee.miller commented

2023-01-11 00:30:18 +00:00

Final build lasted for 57:40 min.

[Final build](https://buildbot.bitmessage.org/#/builders/33/builds/15351) lasted for 57:40 min.

lee.miller force-pushed quectel from a12dd441ae to 7711e71476

2023-01-12 02:58:03 +00:00

Compare

lee.miller added 1 commit 2023-01-12 03:35:43 +00:00

Lookup feeds 77eb0d6017

lee.miller added 1 commit 2023-01-12 03:45:21 +00:00

Forgotten feed a23ab3d351

lee.miller added 2 commits 2023-01-12 21:30:26 +00:00

make package/index 73a409bc6e

Finalize build.sh cb4bb41e58

lee.miller force-pushed quectel from cb4bb41e58 to 1da3e27066

2023-01-12 22:57:58 +00:00

Compare

lee.miller commented

2023-01-12 23:46:39 +00:00

Well, apparently the SDK builds a package alongside with a large dependencies subtree. Not so fast, but there is no need for three hours of building a toolchain (maybe you need to do docker image prune on one of your servers );

The builder makes an image, which is going to out together with packages dir (maybe I need to copy telephony and quectel with dirs?), now you can check.

Well, apparently the SDK [builds a package](https://buildbot.bitmessage.org/#/builders/33/builds/15398) alongside with a large dependencies subtree. Not so fast, but there is no need for three hours of building a toolchain (maybe you need to do `docker image prune` on one of your servers ); The builder makes an image, which is going to `out` together with packages dir (maybe I need to copy `telephony` and `quectel` with dirs?), now you can check.

PeterSurda reviewed 2023-01-13 01:06:15 +00:00

.buildbot/openwrt/build.sh

						
				@ -14,0 +20,4 @@

				cat ${pwd}/feeds.conf >> feeds.conf

				./scripts/feeds update -a

				./scripts/feeds install -a

PeterSurda commented

2023-01-13 01:06:15 +00:00

I think lines 23 and 25 should be skipped, no? That would just recompile unnecessarily. The documentation doesn't mention these steps, only feeds update and then feeds install packagename.

I think lines 23 and 25 should be skipped, no? That would just recompile unnecessarily. The [documentation](https://openwrt.org/docs/guide-developer/obtain.firmware.sdk#obtain_definitions) doesn't mention these steps, only `feeds update` and then `feeds install packagename`.

PeterSurda commented

2023-01-13 01:09:12 +00:00

See also from the documentation:

The output of make might contain WARNING: your configuration is out of sync. Please run make menuconfig, oldconfig or defconfig!. That warning is misleading and wrong in the SDK case. Since everything is precompiled you cannot run oldconfig (see Why is the SDK configuration out of sync?).

See also from the documentation: > The output of `make` might contain `WARNING: your configuration is out of sync. Please run make menuconfig, oldconfig or defconfig!`. That warning is misleading and wrong in the SDK case. Since everything is precompiled you cannot run oldconfig (see Why is the SDK configuration out of sync?).

lee.miller commented

2023-01-13 21:11:16 +00:00

It seems trying to run make menuconfig if I remove make defconfig, see at line 2043.

It seems trying to run `make menuconfig` if I remove `make defconfig`, [see](https://buildbot.bitmessage.org/#/builders/33/builds/15409/steps/3/logs/stdio) at line 2043.

lee.miller commented

2023-01-13 21:13:52 +00:00

It's not working also without feeds install, see line 1979.

It's [not working](https://buildbot.bitmessage.org/#/builders/33/builds/15410/steps/3/logs/stdio) also without feeds install, see line 1979.

PeterSurda commented

2023-01-14 01:16:01 +00:00

I'll check the build logs.

PeterSurda commented

2023-01-14 01:34:01 +00:00

Ok I don't know how to fix it either, at least it doesn't look like it's compiling everything, only some dependencies, so it's fine. I tried a full build previously and it takes several hours: https://buildbot.bitmessage.org/#/builders/33/builds/14862

I will rarely build this so it's not a big deal if I have to wait an hour.

Ok I don't know how to fix it either, at least it doesn't look like it's compiling everything, only some dependencies, so it's fine. I tried a full build previously and it takes several hours: https://buildbot.bitmessage.org/#/builders/33/builds/14862 I will rarely build this so it's not a big deal if I have to wait an hour.

PeterSurda requested changes 2023-01-13 01:10:45 +00:00

PeterSurda left a comment

While I think a part of the process can be skipped, it's exactly what I wanted, thanks. I haven't tested it yet but will shortly.

PeterSurda commented

2023-01-13 04:38:43 +00:00

Test looks good. device state shows among other things

Voice: Yes
SMS: Yes

I was also able to successfully send a SMS from asterisk. I'm having trouble setting up voice and receiving SMS but I think that's due to configuration issues (I'm new to asterisk so I don't know what I'm doing)

Test looks good. `device state` shows among other things ``` Voice: Yes SMS: Yes ``` I was also able to successfully send a SMS from asterisk. I'm having trouble setting up voice and receiving SMS but I think that's due to configuration issues (I'm new to asterisk so I don't know what I'm doing)

PeterSurda commented

2023-01-13 06:29:36 +00:00

Notes:

missing packages to bundle in the image:
- kmod-usb-audio
- asterisk-app-sms
- alsa-lib
user asterisk needs to be added to groups audio and dialout

Notes: - missing packages to bundle in the image: - `kmod-usb-audio` - `asterisk-app-sms` - `alsa-lib` - user `asterisk` needs to be added to groups `audio` and `dialout`

lee.miller added 2 commits 2023-01-13 21:03:13 +00:00

Edit Makefile again 73b6bdecfd

Removed potentially unneeded lines, added missing packages bca65ea2a2

lee.miller added 1 commit 2023-01-13 21:09:41 +00:00

Return defconfig bd2e3823c7

lee.miller force-pushed quectel from bd2e3823c7 to ed3791fe1c

2023-01-13 21:15:52 +00:00

Compare

lee.miller commented

2023-01-13 21:42:06 +00:00

Test looks good. device state shows among other things
...
I was also able to successfully send a SMS from asterisk. I'm having trouble setting up voice and receiving SMS but I think that's due to configuration issues (I'm new to asterisk so I don't know what I'm doing)

Receiving an SMS is even easier, you don't need asterisk for that, gammu-smsd is enough. When I worked at office, I had a simple script for qNAP with a Huawei modem reacting to an SMS (;

#!/usr/bin/env python

import os
import random

import gammu
import gammu.smsd


class SMSDie(object):
    """Main handler class"""
    def __init__(self, passfile):
        with open(passfile, 'rb') as passwords:
            self.passwords = [
                word.strip() for word in passwords
                if not word.startswith('#')]

    def _noop(self):
        pass

    def _offline(self):
        """Go offline"""
        os.system('/etc/init.d/network.sh stop')

    def _feedback(self, number, cmd):
        """Send feedback"""
        # hardcoded config path is bad
        config = '/etc/smsdie/gammu-smsdrc'
        SMS = {
            'Text': 'running command %s' % cmd,
            'Number': number
        }
        try:
            if gammu.Version()[0] <= '1.30':
                sm = gammu.StateMachine()
                sm.ReadConfig(0, 0, '/etc/smsdie/gammu-smsdrc')
                sm.Init()
                SMS.update(SMSC=sm.GetSMSC())
                sm.SendSMS(SMS)
                return

            daemon = gammu.smsd.SMSD(config)
            SMS.update(SMSC={'Location': 1})
            daemon.InjectSMS([SMS])
        except gammu.GSMError as e:
            logwrite('exc %r in feedback' % e)
        except Exception as e:
            logwrite('exc %r in feedback' % e)

    def handle(self, msg, number):
        """Handle SMS message received from number"""
        passwd, cmd = msg.split(' ', 1)
        if passwd not in self.passwords:
            return

        try:
            fun = getattr(self, '_' + cmd)
        except AttributeError:
            return

        self._feedback(number, cmd)

        fun()


if __name__ == "__main__":
    import time
    logwrite('%s INVOKED' % time.time())
    # hardcoded passwords file path is bad
    handler = SMSDie('/etc/smsdie/passwords.txt')
    for i in range(1, int(os.environ['SMS_MESSAGES']) + 1):
        handler.handle(
            os.environ['SMS_%s_TEXT' % i], os.environ['SMS_%s_NUMBER' % i])

Here is a gammu config:

[gammu]
device = /dev/ttyUSB0
connection = at

[smsd]
# service = NULL
# logfile = stderr
# debuglevel = 4
service = files
PIN = 0000
RunOnReceive = /usr/bin/smsdie.py
inboxpath = /tmp/smsd/
outboxpath = /tmp/smsd/
sentsmspath = /tmp/smsd/
errorsmspath = /tmp/smsd/

The gammu is started as /usr/bin/gammu-smsd -c /etc/smsdie/gammu-smsdrc -d --pid=$PIDFILE > $QDK_DIR/smsdie.log.

> Test looks good. `device state` shows among other things ... > I was also able to successfully send a SMS from asterisk. I'm having trouble setting up voice and receiving SMS but I think that's due to configuration issues (I'm new to asterisk so I don't know what I'm doing) Receiving an SMS is even easier, you don't need asterisk for that, gammu-smsd is enough. When I worked at office, I had a simple script for qNAP with a Huawei modem reacting to an SMS (; ```python #!/usr/bin/env python import os import random import gammu import gammu.smsd class SMSDie(object): """Main handler class""" def __init__(self, passfile): with open(passfile, 'rb') as passwords: self.passwords = [ word.strip() for word in passwords if not word.startswith('#')] def _noop(self): pass def _offline(self): """Go offline""" os.system('/etc/init.d/network.sh stop') def _feedback(self, number, cmd): """Send feedback""" # hardcoded config path is bad config = '/etc/smsdie/gammu-smsdrc' SMS = { 'Text': 'running command %s' % cmd, 'Number': number } try: if gammu.Version()[0] <= '1.30': sm = gammu.StateMachine() sm.ReadConfig(0, 0, '/etc/smsdie/gammu-smsdrc') sm.Init() SMS.update(SMSC=sm.GetSMSC()) sm.SendSMS(SMS) return daemon = gammu.smsd.SMSD(config) SMS.update(SMSC={'Location': 1}) daemon.InjectSMS([SMS]) except gammu.GSMError as e: logwrite('exc %r in feedback' % e) except Exception as e: logwrite('exc %r in feedback' % e) def handle(self, msg, number): """Handle SMS message received from number""" passwd, cmd = msg.split(' ', 1) if passwd not in self.passwords: return try: fun = getattr(self, '_' + cmd) except AttributeError: return self._feedback(number, cmd) fun() if __name__ == "__main__": import time logwrite('%s INVOKED' % time.time()) # hardcoded passwords file path is bad handler = SMSDie('/etc/smsdie/passwords.txt') for i in range(1, int(os.environ['SMS_MESSAGES']) + 1): handler.handle( os.environ['SMS_%s_TEXT' % i], os.environ['SMS_%s_NUMBER' % i]) ``` Here is a gammu config: ``` [gammu] device = /dev/ttyUSB0 connection = at [smsd] # service = NULL # logfile = stderr # debuglevel = 4 service = files PIN = 0000 RunOnReceive = /usr/bin/smsdie.py inboxpath = /tmp/smsd/ outboxpath = /tmp/smsd/ sentsmspath = /tmp/smsd/ errorsmspath = /tmp/smsd/ ``` The `gammu` is started as `/usr/bin/gammu-smsd -c /etc/smsdie/gammu-smsdrc -d --pid=$PIDFILE > $QDK_DIR/smsdie.log`.

PeterSurda commented

2023-01-14 01:15:29 +00:00

Receiving an SMS is even easier, you don't need asterisk for that, gammu-smsd is enough. When I worked at office, I had a simple script for qNAP with a Huawei modem reacting to an SMS (;

Yea I used smsd in the past to receive messages with some USB modem, I just wanted to test asterisk. It did show in the logs that there is an incoming SMS but it couldn't be processed due to missing configuration. It just logged an error and deleted the SMS from the SIM. So I think the code is fine, just missing config. The audio device showed up once I installed the alsa-usb module so I think voice calls will also work.

I tried asterisk with two cards, Quectel EC20 and EC25-EUX, it works with both, I don't need to test with more models, the EC20 is the default one they ship with the device so I'll stick with that.

Also one more thing, I use the uac/quectel.conf file instead of the etc/quectel.conf, Quectel wrote on some forum that the UAC audio mode should be preferred.

> Receiving an SMS is even easier, you don't need asterisk for that, gammu-smsd is enough. When I worked at office, I had a simple script for qNAP with a Huawei modem reacting to an SMS (; Yea I used `smsd` in the past to receive messages with some USB modem, I just wanted to test asterisk. It did show in the logs that there is an incoming SMS but it couldn't be processed due to missing configuration. It just logged an error and deleted the SMS from the SIM. So I think the code is fine, just missing config. The audio device showed up once I installed the alsa-usb module so I think voice calls will also work. I tried asterisk with two cards, Quectel EC20 and EC25-EUX, it works with both, I don't need to test with more models, the EC20 is the default one they ship with the device so I'll stick with that. Also one more thing, I use the `uac/quectel.conf` file instead of the `etc/quectel.conf`, Quectel wrote on some forum that the UAC audio mode should be preferred.

PeterSurda merged commit ed3791fe1c into main

2023-01-17 22:27:23 +00:00

Sign in to join this conversation.

No reviewers