Segmentation fault at large expression lists

I just run into this with SquidGuard 1.4 on another platform. I noticed that trimming the easylist expression list to exactly 1000 lines avoids the segmentation fault.

The sed script isn't doing enough. Try this:

/@@.*/d;
/^!.*/d;
/^\[.*\]$/d;
s#http://#^#g;
s,[.?=&/|()[],\\&,g;
s#*#.*#g;
s,\$.*$,,g;

It includes code to escape parenthesis and open square bracket, and it replaces http:// with ^

I don't know if a simple sed script is going to be enough to get the easylist working with SquidGuard.

Hello,

Current adblock list add new patterns that makes squidguard segfaulting again.

Here is the script I use:

#!/bin/sh

temp=`mktemp`
wget --no-check-certificate -O ${temp} http://easylist.adblockplus.org/adblock_rick752.txt

mkdir -p /var/lib/squidguard/db/adblock
rm -f /var/lib/squidguard/db/adblock/expressions

sed -e '/@@.*/d' -e '/^!.*/d' -e '/^\[.*\]$/d' -e 's#http://#^#g' -e 's,[.?=&/|()[],\\&,g' -e 's#*#.*#g' -e 's,\$.*$,,g' ${temp} > /var/lib/squidguard/db/adblock/expressions
sed -i -e 's/^-/\\-/' -e 's/^\+/\\+/' /var/lib/squidguard/db/adblock/expressions

echo 'deezer\.purl\.fr\/php\/zone\/ad' >> /var/lib/squidguard/db/adblock/expressions

update-squidguard

chown proxy.proxy -R /var/lib/squidguard/db/adblock

rm -f ${temp}

The new line are:
+adverts\/
-ad\.html
-banner-ads\/

That are turned into (with the second sed:)
\+adverts\/
\-ad\.html
\-banner-ads\/

Regards, Adam.

Hey I just wanted to say thanks this helped a lot running squidGuard 1.5-static, but there is also one new problem I found after a half hour of lots and lots of segfaulting....

In the latest easylist there are two lines with \9 in them, for whatever reason this caused squidGuard to segfault I had to remove those two lines for it to work.

To the person above that said split or only use the first 1000 lines, while that solution might work for you it's only because there is an issue with the file your using, if you find the problem and fix it then squidGuard can handle all of the 14k+ of regex filters just fine.

- Nick

Nick (bawitdaba),

I think I'm running into the same issue as you with the \9 lines. Could you provide a little more information on how you found them and removed them from the expressionslist?

Much appreciated,

~ James

James,

\9 is perhaps interpreted as a back-reference.

Try to add one of those to your sed script:

A crude removal of the lines:
/.*\\9.*/d;

or just escaping (a little more future proof as far as back-references are concerned)
s/\\\([0-9]\)/\\\\\1/g;

Should do the trick.

Happy filtering.

Cheers.
- Fabrice.

Problem is user specific - resolved.