openresty 1.15.8.1 ngx.re can't work

[vinsonzou]

• Kernel Version: 2.6.32-358.el6.x86_64
• build_info:

nginx version: openresty/1.15.8.1
built by gcc 4.4.7 20120313 (Red Hat 4.4.7-23) (GCC)
built with OpenSSL 1.0.1e-fips 11 Feb 2013
TLS SNI support enabled
configure arguments: --prefix=/usr/local/openresty/nginx --with-cc-opt=-O2 --add-module=../ngx_devel_kit-0.3.1rc1 --add-module=../echo-nginx-module-0.61 --add-module=../xss-nginx-module-0.06 --add-module=../ngx_coolkit-0.2 --add-module=../set-misc-nginx-module-0.32 --add-module=../form-input-nginx-module-0.12 --add-module=../encrypted-session-nginx-module-0.08 --add-module=../srcache-nginx-module-0.31 --add-module=../ngx_lua-0.10.15 --add-module=../ngx_lua_upstream-0.07 --add-module=../headers-more-nginx-module-0.33 --add-module=../array-var-nginx-module-0.05 --add-module=../memc-nginx-module-0.19 --add-module=../redis2-nginx-module-0.15 --add-module=../redis-nginx-module-0.3.7 --add-module=../rds-json-nginx-module-0.15 --add-module=../rds-csv-nginx-module-0.09 --add-module=../ngx_stream_lua-0.0.7 --with-ld-opt=-Wl,-rpath,/usr/local/openresty/luajit/lib --with-stream --with-stream_ssl_module --with-stream_ssl_preread_module --with-http_ssl_module

=== TEST 1:
--- config
    location = /re {
        content_by_lua_block {
            local ngx_re = require "ngx.re"

            local res, err = ngx_re.split("a,b,c,d", ",")
            if err then
                ngx.log(ngx.ERR, "failed: ", err)
                return
            end

            for i = 1, #res do
                ngx.say(res[i])
            end
        }
    }

--- Error log
2019/05/19 17:56:34 [error] 11838#0: *85 lua entry thread aborted: runtime error: /usr/local/openresty//lualib/ngx/re.lua:47: missing declaration for symbol 'ngx_http_lua_ffi_exec_regex'
stack traceback:
coroutine 0:
	[C]: in function 'require'
	content_by_lua(test.conf:22):2: in main chunk, client: 127.0.0.1, server: 127.0.0.1, request: "GET /re HTTP/1.1", host: "127.0.0.1:8080"

[agentzh]

@vinsonzou Seems like your nginx build lacks PCRE? Try the command to check:

ldd /usr/local/openresty/nginx/nginx/sbin/nginx | grep -i pcre

Also, it's recommended to use our official binary packages of OpenResty:

https://openresty.org/en/linux-packages.html

[vinsonzou]

@agentzh tks. I can't build with --with-pcre .

[agentzh]

@vinsonzou You don't have to build with --with-pcre, just install the pcre-dev or pcre-devel system package before building.

[vinsonzou]

@agentzh system pcre-devel can't support utf-8 and jit.
The openresty is not support buildin --with-pcre=the dir ?

nginx version: openresty/1.15.8.1
built by gcc 4.4.7 20120313 (Red Hat 4.4.7-23) (GCC)
built with OpenSSL 1.1.0j  20 Nov 2018
TLS SNI support enabled
configure arguments: --prefix=/usr/local/openresty/nginx --with-cc-opt=-O2 --add-module=../ngx_devel_kit-0.3.1rc1 --add-module=../echo-nginx-module-0.61 --add-module=../xss-nginx-module-0.06 --add-module=../ngx_coolkit-0.2 --add-module=../set-misc-nginx-module-0.32 --add-module=../form-input-nginx-module-0.12 --add-module=../encrypted-session-nginx-module-0.08 --add-module=../srcache-nginx-module-0.31 --add-module=../ngx_lua-0.10.15 --add-module=../ngx_lua_upstream-0.07 --add-module=../headers-more-nginx-module-0.33 --add-module=../array-var-nginx-module-0.05 --add-module=../redis2-nginx-module-0.15 --add-module=../redis-nginx-module-0.3.7 --add-module=../ngx_stream_lua-0.0.7 --with-ld-opt=-Wl,-rpath,/usr/local/openresty/luajit/lib --without-mail_pop3_module --without-mail_imap_module --without-mail_smtp_module --without-select_module --without-http_scgi_module --with-http_stub_status_module --with-http_gzip_static_module --with-http_realip_module --with-http_auth_request_module --with-http_v2_module --with-http_sub_module --with-pcre=/tmp/pcre-8.41 --with-pcre-jit --with-pcre-conf-opt='--enable-utf --enable-unicode-properties' --with-openssl=/tmp/openssl-1.1.0j --with-stream --with-stream_ssl_module --with-stream_ssl_preread_module --with-http_ssl_module

Error output

--- Error log
2019/05/22 18:30:02 [error] 11838#0: *85 lua entry thread aborted: runtime error: /usr/local/openresty//lualib/ngx/re.lua:47: missing declaration for symbol 'ngx_http_lua_ffi_exec_regex'
stack traceback:
coroutine 0:
	[C]: in function 'require'
	content_by_lua(test.conf:22):2: in main chunk, client: 127.0.0.1, server: 127.0.0.1, request: "GET /re HTTP/1.1", host: "127.0.0.1:8080"

[agentzh]

@vinsonzou It does:

$ ./configure --help | grep pcre
  --without-pcre                     disable PCRE library usage
  --with-pcre                        force PCRE library usage
  --with-pcre=DIR                    set path to PCRE library sources
  --with-pcre-opt=OPTIONS            set additional make options for PCRE
  --with-pcre-conf-opt=OPTIONS       set additional configure options for PCRE
  --with-pcre-jit                    build PCRE with JIT compilation support

You can always find it out yourself this way.

[agentzh]

BTW, you can also specify the installation tree location of your own build of PCRE, just as in our openresty rpm packaging process:

https://github.com/openresty/openresty-packaging/blob/master/rpm/SPECS/openresty.spec#L145

[thibaultcha]

Aside: There is a lack of testing for PCRE support in ngx.re. It has always been like so. 30a7266 ensured that resty.core could be loaded in binaries without PCRE support, but ngx.re is an optional module, and doesn't have such a test. Patch incoming.

That said @vinsonzou, you won't be able to use ngx.re if you don't link OpenResty to libpcre, as @agentzh instructed.

[thibaultcha]

A simple patch has been proposed at #259

[vinsonzou]

@thibaultcha @agentzh tks.

[huntkalio]

I have the same problem with building with --with-pcre

2019/06/12 11:06:06 [error] 3936#0: *126458 lua entry thread aborted: runtime error: /opt/openresty/lualib/ngx/re.lua:47: missing declaration for symbol 'ngx_http_lua_ffi_exec_regex' stack traceback:coroutine 0: [C]: in function 'require'

if we build openresty with --with-pcre (use static lib),then there will no function C.pcre_version() in nginx .So,should we not use pcre_version in regex.lua ? @agentzh @thibaultcha