profile
viewpoint

pevers/images-scraper 136

Simple and fast scraper for Google

pevers/PiCam-Setup 6

A simple install script for initializing your Raspberry Pi with mpeg-streamer to stream your webcam.

pevers/conswole 5

CONSOLE ON STEROIDS

pevers/ghj 1

Github Jump! A CLI tool to jump to GitHub relevant pages from the current active branch and repository.

danielcolon/ijzersterk 0

IJzersterk website

pevers/AchtungRemote 0

Achtung die Kurve clone controlled from your phone, this despository contains the protocol and server clone written in C++

pevers/charts 0

Curated applications for Kubernetes

pevers/deno 0

A secure JavaScript and TypeScript runtime

pevers/examples 0

Serverless Examples – A collection of boilerplates and examples of serverless architectures built with the Serverless Framework on AWS Lambda, Microsoft Azure, Google Cloud Functions, and more.

pevers/flappynator 0

Flappy equiped with a Bazooka

push eventpevers/ghj

Peter Evers

commit sha 1fbad8f3ac737fe67967a6343eaecb7423da05c2

add some tests

view details

push time in 16 days

push eventpevers/ghj

Peter Evers

commit sha 0e704a9c7d2df22b84dc2d83057a04f84a0aa696

add hollow tests

view details

push time in 16 days

push eventpevers/ghj

Peter Evers

commit sha 79e27959fb576f5d7838df9e525ee080b74a8bc5

no tests for now

view details

push time in 16 days

push eventpevers/ghj

Peter Evers

commit sha 31212feb5eeedadbf039bea47134705cd5622a4d

add examples

view details

push time in 16 days

startedpevers/ghj

started time in 16 days

push eventpevers/ghj

Peter Evers

commit sha 6cd1caeb9a88dfe5ef353ec81f277f9365f6fb0b

add user note

view details

push time in 16 days

push eventpevers/ghj

Peter Evers

commit sha 30d297577217504b0a3f9418b64f53ca55b2e4fa

GHJ CLI Tool

view details

push time in 16 days

push eventpevers/ghj

Peter Evers

commit sha 1b37293dda7e9177f37d0d58fcb7ad7db7df6b5d

backup

view details

push time in 19 days

PublicEvent

push eventpevers/ghj

Peter Evers

commit sha ec6917e89212490f260d18640e62bd0d5b9f616a

remove bloat

view details

push time in 20 days

startedprisma/prisma

started time in a month

pull request commentdenoland/deno

Fix (cli/net) "unixpacket" send should also return bytes length

LGTM - thanks!

Side note that unixpacket's send will experience the same BorrowMutError that you gave a test case for in #6179 .. The fix will be exactly the same as #6221

@ry Yes, but the interface is slightly different. While the UdpSocket poll_send_to is public with a fat disclaimer. The UnixDatagram poll_send_to is private:

    // Poll IO functions that takes `&self` are provided for the split API.
    //
    // They are not public because (taken from the doc of `PollEvented`):
    //
    // While `PollEvented` is `Sync` (if the underlying I/O type is `Sync`), the
    // caller must ensure that there are at most two tasks that use a
    // `PollEvented` instance concurrently. One for reading and one for writing.
    // While violating this requirement is "safe" from a Rust memory model point
    // of view, it will result in unexpected behavior in the form of lost
    // notifications and tasks hanging.
    pub(crate) fn poll_send_priv(
        &self,
        cx: &mut Context<'_>,
        buf: &[u8],
    ) -> Poll<io::Result<usize>> {

So we need to use the split API there.

pevers

comment created time in 2 months

PR opened denoland/deno

Fix (cli/net) "unixpacket" send should also return bytes length

Similar to issues: https://github.com/denoland/deno/issues/6231

The "unixpacket" transport protocol should also return the bytes sent from op_datagram_send.

+4 -3

0 comment

2 changed files

pr created time in 2 months

issue openeddenoland/deno

(cli/net) op_datagram_send panic for unixpacket transport

Very similar to https://github.com/denoland/deno/issues/6179 . Deno panics when doing a parallel write to the socket.

const socket = Deno.listenDatagram({
  path: "/tmp/test.sock",
  transport: "unixpacket"
});

const a = socket.send(new Uint8Array(), socket.addr);
const b = socket.send(new Uint8Array(), socket.addr);
await Promise.all([a, b]);
socket.close();

Result:

thread 'main' panicked at 'already borrowed: BorrowMutError', /rustc/8d69840ab92ea7f4d323420088dd8c9775f180cd/src/libcore/cell.rs:878:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Caused by: https://github.com/denoland/deno/blob/0ffc99a61ddfa958a436beef0d003ecead630d0f/cli/ops/net.rs#L224

There should be a way to safely borrow the resource in a thread but I don't know how.

created time in 2 months

push eventpevers/deno

Peter Evers

commit sha c27696d56a247713ec237394ade75346d5b3251e

uds should also return byte length on send

view details

push time in 2 months

create barnchpevers/deno

branch : byte-length-for-uds

created branch time in 2 months

issue commentdenoland/deno

Panic when sending UDP without awaiting

@ry I debugged it and found this

Example code that breaks:

const listener = Deno.listenDatagram({
  port: 8080,
  transport: "udp"
});

const encoder = new TextEncoder();
const buffer = encoder.encode('test data');

const buffers = [buffer, buffer];

for(const buffer of buffers){
  listener.send(buffer, {
    hostname: "127.0.0.1",
    port: 8080,
    transport: "udp"
  });
}

Output:

thread 'main' panicked at 'already borrowed: BorrowMutError', /rustc/8d69840ab92ea7f4d323420088dd8c9775f180cd/src/libcore/cell.rs:878:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

At this borrow: https://github.com/denoland/deno/blob/bad6f2b224a92e3bf5cdaf5f8cbc700cb0f9de04/cli/ops/net.rs#L213

It seems like a multi-threading issue. But I lack the knowledge of Rust to come up with a fix.

hazae41

comment created time in 2 months

push eventpevers/deno

Peter Evers

commit sha b50426fe1ed8b8cf658f1e651e18c8d436b3dafd

extend std/util/node types

view details

push time in 2 months

PR opened denoland/deno

Extend std/util/node types

This PR adds all missing util.types to the std Node library. See: https://nodejs.org/api/util.html#util_util_types

Tests are created from the examples in the Node docs.

Node is using internal bindings to verify the types. That is why I sometimes adapted the implementation from Lodash instead.

Exceptions:

  • isProxy. Could not be implemented in Typescript.
  • isExternal. Specific to Node bindings and not portable.

This is a requirements for https://github.com/denoland/deno/issues/6011

+668 -16

0 comment

2 changed files

pr created time in 2 months

push eventpevers/deno

David Sherret

commit sha fcae2fec879caf26ebe7af17b30a3bce6322b85d

Upgrade to swc_ecma_parser 0.24.5 (#6077)

view details

uki00a

commit sha 9bd5c08d5a2a9cdd2649dd24a4d6b26d9af2a4c4

feat(doc): handle detail output for enum (#6078)

view details

Nayeem Rahman

commit sha 97d876f6db55f5f32ac06155dcb4823e1c636215

fix(std/http): Don't use assert() for user input validation (#6092)

view details

Szalay Kristóf

commit sha 42a04ea08a09e29417518524cbe2245c165e6f55

refactor(std/testing/bench): Remove differentiating on runs count (#6084)

view details

Ryan Dahl

commit sha e3cc3db20fc86d9adb19bb472e8c96ae5f7c77c0

Revert "feat: format deno bundle output (#5139)" (#6085) This reverts commit 93cf3bd5341d5985201ea0905280082d5a3310f9.

view details

Jon Short

commit sha 4b1638dccc601ff0282172c7e3ef0f1126a603ed

feat(std/testing): Allow non-void promises in assertThrowsAsync (#6052)

view details

Matt Dumler

commit sha a04166e9fa87450dfa910afeaf0c1dad988f3988

deno doc docs (#5650)

view details

Yusuke Sakurai

commit sha 430beebc46be1dc87a993c2f7442c5c22076f458

doc: Improved ws example and README (#5636)

view details

skdltmxn

commit sha e05ed537130eff116b48af02d1eb6ce65953e7d8

feat(std/hash): add sha3 (#5558)

view details

Bert Belder

commit sha 7069d60423979858ece856d52ef9567a50f8ef76

ci: use upstream actions/cache@v2 (#6113) Upstream finally tagged v2.0.0 so there's no reason to use our own fork any longer.

view details

Bert Belder

commit sha 9a783ae4e6789fc90c8a6d62e846c9abd29e7d2f

ci: upgrade to Rust 1.44.0 (#6113)

view details

Andrew Mitchell

commit sha c4c6a8dae488a3473ee09b0e3a54943b706d8944

fix: Use # to denote line number in stack traces (#6114) This makes the URLs in stack traces actual URLs to the files. Before: https://deno.land/std/testing/asserts.ts:138:11 After: https://deno.land/std/testing/asserts.ts#138:11

view details

Ryan Dahl

commit sha 78bfeebad11954666d3104ea3556ec9f2e64f6a4

Revert "fix: Use # to denote line number in stack traces" (#6119) This reverts commit c4c6a8dae488a3473ee09b0e3a54943b706d8944 There is some controversy about this change because vscode doesn't interpret the fragments correctly. Needs more discussion before landing.

view details

Bert Belder

commit sha ee7727cd078b56d2ecc5d93f9308709e60a18949

To find home dir, use only $USERPROFILE on Windows, $HOME on Posix (#6132) $HOME is meaningless on Windows. It may be set by users or by third party software, but it is non-standard and should not be relied upon. Likewise, $USERPROFILE is meaningless on other platforms.

view details

Bert Belder

commit sha 18670c47e69ec2b9ceef6ec0011fbbdc4b845be6

fix: 'deno upgrade' doesn't work on Windows 8.1/PowerShell 4.0 (#6132) Fixes: #6109

view details

Taisuke Fukuno

commit sha d2243b1125722e775b1f9719197260d1cda1220d

deno test should run mjs files (#6122)

view details

Ryan Dahl

commit sha 79d9cf52d0298ba85e0ac4a58014116bb84bfc59

fix(core): ES module snapshots (#6111) Co-authored-by: Bert Belder <bertbelder@gmail.com>

view details

Taisuke Fukuno

commit sha 93175b7a79e09381ea556539f10cde9eaa61af89

added mjs files for default fmt (#6134)

view details

Chris Knight

commit sha c137b11abfb946ef72a5fcb27e11e0b286a33be3

fix: revert setInterval log flushing as it prevents process completion (#6127)

view details

Casper Beyer

commit sha ed5aedc6b4a1d72208649afd8793e288d94021b1

Rename abbreviated assertions in std/testing (#6118)

view details

push time in 2 months

push eventpevers/deno

Peter Evers

commit sha 960de528b9337414b8775c814b1f2122e016255d

extend std/util/node types

view details

push time in 2 months

push eventpevers/deno

Peter Evers

commit sha 96c2dc5110587cdd89425722f5c9e7880aee9a3b

extend std/util/node types

view details

push time in 2 months

delete branch pevers/deno

delete branch : util-add-is-date

delete time in 2 months

starteddanistefanovic/build-your-own-x

started time in 2 months

create barnchpevers/deno

branch : extend-types

created branch time in 2 months

Pull request review commentdenoland/deno

feat(std/node/util) add util.types.isDate

+export * as types from "./_util/_util_types.ts";

Thanks for the suggestion. I have fixed it and the build is now green.

pevers

comment created time in 2 months

push eventpevers/deno

Peter Evers

commit sha 5539620bdda9d1b160847924f0fa0f085ddfc02a

add util.type.isDate

view details

push time in 2 months

push eventpevers/deno

Peter Evers

commit sha 0dd88f6b0ddf6cff4bd864f330874612d63e4a1b

add util.type.isDate

view details

push time in 2 months

push eventpevers/deno

Peter Evers

commit sha 7208aa28ccdfefea26c141a546532212661248f8

add util.type.isDate

view details

push time in 2 months

push eventpevers/deno

Peter Evers

commit sha 2a5eb62cdcf85263ff5ffeb8ef67367f534a0e66

3.8 scope not supported

view details

push time in 2 months

push eventpevers/deno

Peter Evers

commit sha 12db9ae652690df294120b09240590e4a14e17b4

fix lint

view details

push time in 2 months

PR opened denoland/deno

feat(std/node/util) add util.types.isDate

This PR adds util.types.isDate to the Node compatibility layer. Specs: https://nodejs.org/dist/latest-v14.x/docs/api/util.html#util_util_types_isdate_value

The util.isDate method is depcrecated. Instead, util.types.isDate should be used. That is why I created the types module on top of util.

Tests are ported from the NodeJS source code. Implementation details are from Node before it was ported to the internal types binding. I couldn't find something similar in Deno (yet) so I went for this approach.

This PR is a requirement for https://github.com/denoland/deno/issues/6011

+92 -0

0 comment

3 changed files

pr created time in 2 months

create barnchpevers/deno

branch : util-add-is-date

created branch time in 2 months

issue openeddenoland/deno

Implement std/node/util isDeepStrictEqual

isDeepStrictEqual is not yet supported from Node's util library: https://nodejs.org/dist/latest-v14.x/docs/api/util.html#util_util_isdeepstrictequal_val1_val2

Implementation can be found here and should be added to the Deno std library + tests: https://github.com/nodejs/node/blob/master/lib/internal/util/comparisons.js

I would like to take this task upon me if adding this is fine.

created time in 2 months

startednodejs/node

started time in 2 months

delete branch pevers/deno

delete branch : fix-denoblob-name

delete time in 2 months

issue commentdenoland/deno

blob.constructor.name should return Blob not DenoBlob

I tried to come up with a solution as described in: https://github.com/denoland/deno/pull/4736#discussion_r407615942

Let me know what you think @ry : https://github.com/denoland/deno/pull/5879

therealadityashankar

comment created time in 2 months

push eventpevers/deno

Peter Evers

commit sha 8b9a129bdf32e1db8d6a07bcbb34f5880e859e75

fix DenoBlob name

view details

push time in 2 months

push eventpevers/deno

Peter Evers

commit sha 53792b970800990e0c6ed4a5c58d8230b899336b

fix name for DenoBlob

view details

push time in 2 months

push eventpevers/deno

Peter Evers

commit sha f5844b4a9b275cdaf3b944be4f0c4c14084b3629

another attempt

view details

push time in 2 months

push eventpevers/deno

Peter Evers

commit sha 847bda6c0a91579f6e2293d1cef4f0d1cbbadacd

formatting fix

view details

push time in 2 months

push eventpevers/deno

Peter Evers

commit sha 15d20a1dd455addc08c06a7cdfba0325d6237335

fix name for DenoBlob

view details

push time in 2 months

push eventpevers/deno

Peter Evers

commit sha d3abbaffd1df6ad5b73239937cf4ed9c927d037b

fix name for DenoBlob

view details

push time in 2 months

PR opened denoland/deno

Fix name for DenoBlob

This should fix https://github.com/denoland/deno/issues/5851

Executed as described in this comment: https://github.com/denoland/deno/pull/4736/files#r407832029

Until all cli code is converted to JS this should fix Blob being named DenoBlob.

const b = new Blob()
b.constructor.name
DenoBlob
+14 -1

0 comment

2 changed files

pr created time in 2 months

push eventpevers/deno

Chris Knight

commit sha 9090023c33de7b64ae41425db71c9ab4d5b1237f

docs: "Getting started" manual updates (#5835)

view details

Bartek Iwańczuk

commit sha f462f7fe54d59b2d56ffbb03ca8467ce93096817

fix: parsing of JSX and TSX in SWC (#5870)

view details

zfx

commit sha 24c36fd8625df6b276108109478a62b4661a0b3f

fix(std/log): use writeAllSync instead of writeSync (#5868) Deno.writeSync: Returns the number of bytes written. It is not guaranteed that the full buffer will be written in a single call.

view details

Kitson Kelly

commit sha 228f9c207f8320908325a553c96e465da08fc617

Use ts-expect-error instead of ts-ignore. (#5869)

view details

Robin Wieruch

commit sha 44477596eda3ca50ea6597d4af1fd809a01e2bdc

improve docs (#5872)

view details

Robin Wieruch

commit sha 845bc443da6026903aefa7a6556ecc7c0de371fe

improve docs (#5873)

view details

crowlKats

commit sha d4711feba86ce26044ebffd625b9b9ee872e0f1a

docs: update JetBrains environment support (#5877)

view details

Peter Evers

commit sha 64d14d03649e3c8f086dbeff8acfde50bc116044

fix name for DenoBlob

view details

push time in 2 months

create barnchpevers/deno

branch : fix-denoblob-name

created branch time in 2 months

startedalexnederlof/node-and-protoc

started time in 2 months

fork pevers/deno

A secure JavaScript and TypeScript runtime

https://deno.land/

fork in 2 months

startedjlevy/the-art-of-command-line

started time in 2 months

pull request commentpevers/images-scraper

wait for the links

Thanks!

letoribo

comment created time in 3 months

push eventpevers/images-scraper

Peter Evers

commit sha af85ec308060aa1852a2457d32d2504186580fc1

bump version

view details

push time in 3 months

push eventpevers/images-scraper

yuriy_chistyakov

commit sha 68737b3167ad4f46e9340b093a6218699e1201a2

wait for the links

view details

yuriy_chistyakov

commit sha 98d61f8c9403ce0d1bc99302540f62a2bb751fd5

fix waiting for selector

view details

yuriy_chistyakov

commit sha 2f7d658fb81af7df3495458d8b5850e234060e59

change logging level

view details

Peter Evers

commit sha 3f8ced1d4a06529e0176b78a69b368b68d55b87d

Merge pull request #51 from letoribo/master wait for the links

view details

push time in 3 months

PR merged pevers/images-scraper

Reviewers
wait for the links

images-scraper results array fix

+2 -1

0 comment

1 changed file

letoribo

pr closed time in 3 months

Pull request review commentpevers/images-scraper

wait for the links

 class GoogleScraper {     while (results.length < limit) {       await this._scrollToEnd(page);       await this._clickAllImages(page);-      await page.waitFor(200);  // Delay needed to inject the JS elements+      await page.waitForSelector("#islrg a[href^='/imgres']", { timeout: 1000 })  // Wait for the selector to appear in page.+      .catch(() => logger.info('No results on this page')); // Unblock the flow

Can you change this to the debug log-level?

letoribo

comment created time in 3 months

issue commentpevers/images-scraper

Example code returns an empty array.

the results array is sometimes still empty. fixed this by switching to page.waitForSelector:

letoribo@68737b3

Thanks! Can you open a pull request. Then I will merge it.

IamRifki

comment created time in 3 months

delete branch pevers/images-scraper

delete branch : fix-scroll-delay

delete time in 3 months

issue commentpevers/images-scraper

NPM Test is failing

Thanks for reporting @Extracreative . I believe it is fixed in: https://github.com/pevers/images-scraper/pull/50

There were some issues with JS injection of the real image URLs.

Extracreative

comment created time in 3 months

issue commentpevers/images-scraper

Example code returns an empty array.

Thanks @letoribo for reporting. I think it is fixed in: https://github.com/pevers/images-scraper/pull/50

IamRifki

comment created time in 3 months

push eventpevers/images-scraper

Peter Evers

commit sha 77d1ad33ee3050f65acab67d46631e3c619c85cd

fix JS injection delay

view details

Peter Evers

commit sha 4f30ebcbbe3f59221999d20da37604b1307c06a2

bump version

view details

Peter Evers

commit sha 7749840e6570e958b3155b152366a27ee3dc6f7a

Merge pull request #50 from pevers/fix-scroll-delay Fix JS injection delay

view details

push time in 3 months

PR merged pevers/images-scraper

Fix JS injection delay

Script didn't wait for JS injection of images. This will add a 200ms delay for the page to finish loading.

+2 -1

0 comment

2 changed files

pevers

pr closed time in 3 months

PR opened pevers/images-scraper

Fix JS injection delay

Script didn't wait for JS injection of images. This will add a 200ms delay for the page to finish loading.

+2 -1

0 comment

2 changed files

pr created time in 3 months

push eventpevers/images-scraper

Peter Evers

commit sha 4f30ebcbbe3f59221999d20da37604b1307c06a2

bump version

view details

push time in 3 months

create barnchpevers/images-scraper

branch : fix-scroll-delay

created branch time in 3 months

IssuesEvent
more