XVFB fails on server.

At a glance

The community member has deployed a Playwright with Chromium crawler on AWS Batch, but is encountering an error where the crawler needs to run in headful mode to click certain buttons that don't load. They have tried creating a custom slimmer image, but still face the same issue with Xvfb.

In the comments, another community member suggests that the issue may be related to AWS Batch overwriting the CMD command from the Dockerfile. Another community member shares a Dockerfile example to get Xvfb running, which the original poster finds helpful and plans to try. The community members also discuss using the official Chrome build instead of Chromium and modifying the Dockerfile to suit their needs.

NNeoNomade

I've deployed a playwright with chromium crawler on aws batch, with the default docker image.
this is the error that I'm getting, it's mandatory for this crawler to run headful because otherwise there are some buttons that I need to click that are not loading.
(Error log attached).
I've also tried to create a custom slimmer image, but I bump into the same issue with Xvfb.

16 comments

NNeoNomade

, any ideas ?

mmicroworlds

Hi can you please recommend a solution to this? I am also stuck here 😅 Thanks!

NNeoNomade

On my side it got fixed … aws batch was overwriting my CMD command from the dockerfile .

mmicroworlds

That's smooth! Still an issue for me here. If it's not to much to ask, could you please share with me the Dockerfile (at least only the part to get Xvfb running)? Thanks! 🙏

NNeoNomade

On what have you based your image ?

mmicroworlds

apify/actor-node-puppeteer-chrome:latest

NNeoNomade

Why ? :))
It’s very big and slow

mmicroworlds

I want all the layers therein. Any recommendations for a slimmer image, with Xvfb and same Apify experience?

NNeoNomade

Where are you deploying ?

mmicroworlds

Google Cloud Run

NNeoNomade

Plain Text

FROM node:lts

RUN apt-get update && \
    apt-get install -y xvfb x11-xkb-utils xfonts-100dpi xfonts-75dpi xfonts-scalable x11-apps chromium && \
    rm -rf /var/lib/apt/lists/*
    
WORKDIR /usr/src/app
COPY package*.json ./
COPY *.tgz ./

RUN npm --quiet set progress=false \
    && npm install --omit=dev --omit=optional \
    && echo "Installed NPM packages:" \
    && (npm list --omit=dev --all || true) \
    && echo "Node.js version:" \
    && node --version \
    && echo "NPM version:" \
    && npm --version

COPY . ./
ENV DISPLAY=:99


CMD xvfb-run -a npm start --silent

I'm also working on an alpine version, but this is much quicker and easier.

NNeoNomade

you can remove the ENV, and the second copy.

mmicroworlds

Thanks a lot. That was helpful. Will give it a shot ✨

mmicroworlds

I'd like to run the official chrome build instead of chromium and install a few other packages too. Anyways, I'll modify the Dockerfile to suit my needs. Thanks!

NNeoNomade

What is the difference ?

mmicroworlds

Not much, just some personal preferences 😅

Add a reply

Apify Discord Mirror

XVFB fails on server.