Combine SSR and RSC responses + Request Provider

Description
Attempt to implement #250
This PR is an exploration on how to implement Server-only context that is supported by the official RSC and how to combine SSR+RSC responses into 1 (for performance). Feedback is very welcome.
This is using the official RSC just like in #317 and adding a few extra features:

It adds a request.context object where we can store everything related to the current request.
In SSR, it wraps the React tree in a Context/Provider (context is supported in SSR) in order to provide the current request object (and request.context)  to the React tree.
In RSC, it uses React.unstable_getCacheType to create some kind of cache that is scoped to the current RSC rendering (i.e. it doesn't conflict with other requests). In this cache, it stores the current request so it can be retrieved from anywhere in the React tree (just like a context provider, but works in RSC).
Adds an internal useServerRequest hook that gets the current request anywhere in the tree (only callable from server components).

So far, we have Server-only Context to store data that is scoped to the current request, both in SSR and RSC, and have it available anywhere in the React tree. Examples of things to store here are: fetch promises (just like RenderCacheProvider in main branch); logger that shows the current request data; etc.
Finally:

It runs SSR and RSC concurrently for the same request with a shared request.context.cache for fetch promises. This means it generates both responses at the same time but without repeating subrequests. When the SSR is done, it attaches the RSC response to the HTML and uses it in the browser instead of making a new RSC request.

Things not implemented

This only works in Node right now to validate this approach, so no workers for now.
The RSC response is currently inlined at the end of the HTML. It should also be possible to stream chunks as they come by  wrapping them in script tags:

response.write(`<script>window.__flight.push(${JSON.stringify(rscChunk)})</script>`)

Every rscChunk is one line of the flight response so it can be consumed in the browser to prefetch client components asap.
Additional Context
Follow #317 indications to try this locally.
I'm not 100% if this all works well yet for bigger apps (it should?). There is a problem when having 2 tabs open (2 requests at the same time) related to the SSR context/provider (the context gets lost), but the RSC side works well. Not sure if I'm using Context/Provider correctly.

As mentioned in the OP, there's an issue with the SSR part where the context of ServerRequestProvider is lost after a while when 2 requests happen at the same time. To reproduce, open 2 tabs and restart the server, or directly run this in the browser console:
function doRequest() { return fetch('http://localhost:3000', {headers: {accept:'text/html'}}) }
await Promise.all([doRequest(), doRequest()])

I've been debugging this but I can't find why it happens. The same strategy currently works in main branch. It keeps happening even after commenting out all the RSC part.
@wizardlyhel Do you see any difference between your RenderCacheProvider and this ServerRequestProvider? 🤔

This is super cool by the way - Just got it running on my local machine and looking on that double request issue

This is super cool by the way - Just got it running on my local machine and looking on that double request issue

This is very interesting - the RSC flight injection is happening before the body streams. I'm gonna play around a bit and see how this behaves by putting a couple suspense boundaries.

@wizardlyhel Thanks a lot for testing it! Glad it works 😅


Didn't find the cvAvgSdv function, not yet implemented?

as title

I can't find this function in the documentation (https://docs.opencv.org/4.6.0/), are you sure it exists?


test(minifier): port all replace_known_methods tests.

#6418  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @7086cmd and the rest of your teammates on  Graphite

Merge activity

Oct 10, 6:18 AM EDT: The merge label '0-merge' was detected. This PR will be added to the Graphite merge queue once it meets the requirements.


Fix volume driver mismatches

This PR makes node filtering to actually use volume plugin/driver version as part of the criteria. (commit by @jakolehm, cherry picked that from a WIP branch).
This also changes the agents VolumeManager to omit the version/tag when checking volume existence as there might be different plugin versions used within the grid.
Fixes #2261

LGTM on the agent drivers_match? part, but I don't think the Scheduler::Filter::VolumeDriver change is a good idea...
It will break deployments of any existing volumes created using kontena volume create --driver foo/bar, without a version?
It requires volumes to be created using specific kontena volume create --driver foo/bar:x.y versions? That seems like a broken feature without some kind of kontena volume upgrade --driver-version x.z to deal with driver version upgrades? Also missing validations for Volumes::Create#driver...

I think the right fix for both the agent drivers_match? and server Scheduler::Filter::VolumeDriver is to support an optional version suffix in the kontena volume --driver. If the version suffix is there, then match it against the actual driver version, otherwise, omit the actual driver version from both comparisons?

I think the right fix for both the agent drivers_match? and server Scheduler::Filter::VolumeDriver is to support an optional version suffix in the kontena volume --driver. If the version suffix is there, then match it against the actual driver version, otherwise, omit the actual driver version from both comparisons?

I agree. Already made couple of commits to reflect that thinking.

The Volumes::Create mutation should perhaps also validate the driver param with a regex.

:white_check_mark: Tested that all of --driver local, --driver vieux/sshfs and --driver vieux/sshfs:latest work.

Dropping the version/tag support would mean:

Master needs to fill in the tag when sending volume info to agent
volume create mutation needs to validate the volume so that it does not container the tag

Other than that, the implementation reverts pretty close to the original implementation. Even the agent check for driver match would revert back to the original as master would have filled in the correct version for that node.

obsoleted by #2526

TBH I'm not really comfortable with the operational complexity of trying to understand how the additional logic in #2526 to select the driver version will behave. I'm concerned that it will break if the plugin versions installed on the host nodes change. Based on my own testing, I still think the approach of optional driver versions here is correct, and fits best with how the actual Docker plugins work?
For the typical usecase, where you use builtin drivers (local), or use the latest version of plugin drivers (docker plugin install vieux/sshfs -> vieux/sshfs:latest), then you can just use kontena volume create --driver vieux/sshfs without any specific version. You can still use docker plugin install --alias vieux/sshfs:latest vieux/sshfs:1.0, or docker plugin upgrade vieux/sshfs vieux/sshfs:next to manage the installed plugin versions, which upgraded across nodes without needing to re-create the Kontena volumes.
If you have more specific plugin version requirements like rexray/s3fs:0.8.2, then you can install those using either the upstream labels like edge or latest (see Docker Hub), or some local --alias rexray/s3fs:testing, and then use kontena volume create --driver rexray/s3fs:edge, kontena volume create --driver rexray/s3fs:testing etc. You can even have multiple versions of the plugins installed, using e.g. latest for your production volumes, and have some separate testing label that you docker plugin upgrade to the latest release before upgrading the default latest plugin?

I think we need to remove volume driver version specify. It's too confusing to users and also freezes plugin version (hard to install newer versions to fresh nodes without removing old installation first).

My understanding of the issue with driver versions here is something like the following:

node-1 docker plugin install rexray/s3fs:0.8.2
node-1 docker plugin upgrade rexray/s3fs:0.8.2 rexray/s3fs:0.9.1
node-2 docker plugin install rexray/s3fs:0.9.1

This results in the both nodes running the same 0.9.1 version, but the Docker volume driver on node-1 is still rexray/s3fs:0.8.2, whereas on node-2 it is rexray/s3fs:0.9.1. There would be no way to create/deploy the same Kontena volume to both nodes in this case.


Jump search using c#

Have you read the Contributing Guidelines on Pull Requests?
Yes
Description
Added the code of Jump Search using C#
Checklist

[x] I've read the contribution guidelines.
[x] I've checked the issue list before deciding what to submit.
[x] I've edited the README.md and link to my code.

Related Issues or Pull Requests
#6270

@HarshCasper Please review this PR.


Update neptune_utils.py

Minor updates to solve some Neptune warnings on the new syntax.
I still get multiple warnings with the type of variables.
Can you have a look at line 76, it only works for me when the type is changed.

Thanks the the patch! I'll take a closer look and cross-test against older neptune versions to ensure we maintain backwards compatibility.


Use a Path instead of a directory string and file string parameter

Also added java 8 specification to the build script and removed an unused import from a test class

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Looks good, but the tests should be updated accordingly.
You can remove the shareSecretLog test, it's probably better to handle that in the applications that use the library

Thanks! Had to do those last couple commits on mobile


Stop deleting all the Secret metadata

Problem Statement
The labels and annotations on a Secret are removed if creationPolicy = Owner. The details are described in https://github.com/external-secrets/external-secrets/issues/2864
Related Issue
Closes https://github.com/external-secrets/external-secrets/issues/2864
Proposed Changes
As I commented here, at first I tried introducing SSA but soon realized it complicated the logic too much without much to gain. So instead of going down the path, I updated the setMetadata function to modify the metadata managed by the operator. With this approach, we can avoid reintroducing https://github.com/external-secrets/external-secrets/pull/2705 as well.
Checklist

[x] I have read the contribution guidelines
[x] All commits are signed with git commit --signoff
[x] My changes have reasonable test coverage
[x] All tests pass with make test
[x] I ensured my PR is ready for review with make reviewable

/ok-to-test sha=70e2b866c8ec6a620000180e21cc3728c62cfdf9

/approve


Reuse previously allocated compressors

libdeflate_alloc_compressor() is doing a significant amount of work which doesn't need to be repeated in consecutive compressor calls. At lower levels (e.g. level 1), compressor allocation and deallocation accounts for a significant % of the time spent in libdeflate_*_compress() (30% in my local tests).

Implemented by 0642334f83ec3a4c693d9fe9557a9f5665c25691.


The text content overflow

If text content overflow, the Text widget should cut  the content. More, the Text widget should have a property(singleLine or  multiLine) for configuration.

Yeah, there's already a bug on file for text-overflow ellipsis.  Let's keep this issue open for more general thinking about text overflow effects.

https://github.com/flutter/flutter/issues/417 is the issue about ellipsis

https://github.com/flutter/flutter/pull/3818 has isSingleLine and a couple overflow effects.  We can add more if there's something specific you want to do.

We now support a couple different TextOverflow treatments.  https://github.com/flutter/flutter/issues/4202 is a specific bug about multiline overflow effects.  Hopefully what we have now is sufficient for your purposes.  If not, please open more specific bugs about what you'd like to see.


Merge mailing for weekend

All the new submissions (or updates) received between Friday and Sunday are merged into one mailing. Should we do the same here?

Implemented in #8


JTI claim missing in generated JWT access token

Describe the bug
JTI claim missing in generated JWT access token
To Reproduce
Generate JWT access token using client_Credentials grant type
Expected behavior
A jwt token with following default claims:
{
"sub": "testClientAK2",
"aud": "testClientAK2",
"nbf":<PHONE_NUMBER>,
"scope": [""],
"iss": "http://localhost:9000",
"exp":<PHONE_NUMBER>,
"iat":<PHONE_NUMBER>,
"jti": xxx
}
Sample
My current JWT token has the following:
{
"sub": "testClientAK2",
"aud": "testClientAK2",
"nbf":<PHONE_NUMBER>,
"scope": [""],
"iss": "http://localhost:9000",
"exp":<PHONE_NUMBER>,
"iat":<PHONE_NUMBER>,
}
I would like to ask how to set the jti claim(by default) in the access token.

Related stackoverflow question: https://stackoverflow.com/questions/77096271/how-to-set-jti-claim-in-jwt-token-generated-by-spring-authorization-server
Note: I asked the reporter to open an issue, but this issue was opened previously (as a cross-post of the question).

Yes, it was opened parallelly for a quicker response. But thanks for consideration

@jasmine0508 Questions are better suited to Stack Overflow. We prefer to use GitHub issues only for bugs and enhancements.
Closing as duplicate of gh-1308

I agree, hence I had raise a question on stackoverflow and post the response of one of the users (https://stackoverflow.com/users/15835039/steve-riesenberg), and post providing justifications for the same, shared the same as an enhancement.
Me - Have a look at auth0.com/docs/secure/tokens/json-web-tokens/…. Though these are Optional but the document says "The JWT specification defines seven reserved claims that are not required, but are recommended to allow interoperability with third-party applications."
Steve - Ok, so not a spec but a recommendation by Auth0. Thanks! I think it would be worth opening an issue for that to discuss whether it should be added by default. –
Steve Riesenberg
Hence raised it as a request. Ofcourse everything can be customized in the token including jti. But considering it as a part of JWT token was the request. As I had already checked that opaque token had jti claim added by default

@jasmine0508 Re-opening this and I updated the title to reflect that this is an enhancement request.


Multi select list is now ordered.

This behaviour is not configurable.
Summary
List of available repositories during the interactive execution of minder repo register is now sorted.
This change was suggested by @rdimitrov
Change Type

[ ] Bug fix (resolves an issue without affecting existing features)
[x] Feature (adds new functionality without breaking changes)
[ ] Breaking change (may impact existing functionalities or require documentation updates)
[ ] Documentation (updates or additions to documentation)
[ ] Refactoring or test improvements (no bug fixes or new functionality)

Testing
Ran the Minder CLI locally against Production and verified that the list of repositories presented to the user during interactive registration are sorted.
Review Checklist:

[X] Reviewed my own code for quality and clarity.
[ ] Added comments to complex or tricky code sections.
[ ] Updated any affected documentation.
[ ] Included tests that validate the fix or feature.
[X] Checked that related changes are merged.

coverage: 49.286% (-0.02%) from 49.305%
when pulling 177bc99453911353c8621b51d22ba0795aef0434 on repo-register-sort-selection
into 052a79d0ffef741714d0c438de06b46dde2befab on main.


Build template from resources

Sometimes it is required to deliver the connector catalog as a template, in order to integrate with 3rd party systems. This commit adds that functionality in a very simplistic way
Signed-off-by: Luis Garcia Acosta<EMAIL_ADDRESS>

Related with https://github.com/bf2fc6cc711aee1a0c2a/cos-fleet-catalog-camel/pull/82


WIP: Auth teams attachments

Description

Checklist:

[ ] Have you documented your changes in the pull request description?
[ ] Does the change present any security considerations?
[ ] Is any gem functionality overloaded? Eg: Devise controller methods being overloaded.
[ ] Has acceptance criteria been tested by a peer?
[ ] Has the CHANGELOG been updated? (If change is worth telling users about.)

General testing (author)

[ ] Test without JavaScript
[ ] Test on small screen

Accessibility testing (author)

[ ] Works keyboard only
[ ] Tested with one screen reader
[ ] Zoom page to 400% - content still visible
[ ] Disable CSS - does content make sense and appear in a logical order?

Codecov Report

Merging #1658 (492f6b5) into master (db5c8ab) will decrease coverage by 86.13%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##           master   #1658       +/-   ##
==========================================
- Coverage   89.77%   3.64%   -86.14%
==========================================
  Files         401     401
  Lines        8588   13091     +4503
  Branches     1235     223     -1012
==========================================
- Hits         7710     477     -7233
- Misses        701   12613    +11912
+ Partials      177       1      -176

Impacted Files
Coverage Δ

...ntrollers/active_storage/blobs/proxy_controller.rb
0.00% <0.00%> (-100.00%)
:arrow_down:

app/models/role.rb
0.00% <0.00%> (-100.00%)
:arrow_down:

app/models/team.rb
0.00% <0.00%> (-100.00%)
:arrow_down:

app/models/alert.rb
0.00% <0.00%> (-100.00%)
:arrow_down:

app/models/contact.rb
0.00% <0.00%> (-100.00%)
:arrow_down:

app/models/country.rb
0.00% <0.00%> (-100.00%)
:arrow_down:

app/models/product.rb
0.00% <0.00%> (-100.00%)
:arrow_down:

app/models/accident.rb
0.00% <0.00%> (-100.00%)
:arrow_down:

app/models/incident.rb
0.00% <0.00%> (-100.00%)
:arrow_down:

app/models/location.rb
0.00% <0.00%> (-100.00%)
:arrow_down:

... and 359 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update db5c8ab...492f6b5. Read the comment docs.


feat: include multivalue form data as an array

In a multipart/form-data or a application/x-www-form-urlencoded POST request, if there are multiple values for a given field name (key), c.req.parseBody() will not only include one of them.
This makes it so that when using c.req.parseBody(), if there are multiple values for a given key, they'll be included in an array.
Author should do the followings, if applicable

[x] Add tests
[x] Run tests
[x] yarn denoify to generate files for Deno

Hi @calebkish
Thanks for the PR. I'd like to merge this PR, but this is a breaking change. So, we'll accept when releasing the next major version, "v4".

I'm going to close this in favor of https://github.com/honojs/hono/pull/1461
I think it pretty much covers the concerns of this PR.


Combine Event_Completions and Event_Cancelations sql tables into 1 table

Combine the sql tables Event_Completions and Event_Cancelations into 1 table: Event_Actions.
Need to create 2 new sql tables: Event_Actions and Event_Action_Types.

SQL Table Defs

Event_Action_Types

id
name (completion, cancelation)

Event_Actions

event_id
date
event_action_type_id
created_on


feat: Integrate with Base

We need to integrate support for creating name.base.eth domains on our platform, which currently facilitates Ethereum name registrations. This integration will allow users to seamlessly create and manage [base subname].eth domains, expanding our platform's capabilities to support the Base network's domain naming convention.
Acceptance Criteria:

[ ] Users can successfully create and register name.base.eth domains.
[ ] Users can edit text records for name.base.eth domains.
[ ] Users can create subdomains of name.base.eth.

it won't be base.eth since its already being used by someone else, another name will be used instead pointing to the base contracts

waiting for the feedback from Coinbase whether they will follow the Wildcard Writing ENSIP on their contracts before we integrating base on our dapp


docker exec -ti 3cx /usr/sbin/3CXWizard --cleanup

When I do docker exec -ti 3cx /usr/sbin/3CXWizard --cleanup
I get this error:
Failed to connect to bus: No such file or directory
Full command output:
Removed /etc/systemd/system/3CXQueueManager01.service.
Removed /etc/systemd/system/3CXCallFlow01.service.
Removed /etc/systemd/system/3CXSystemService01.service.
Removed /etc/systemd/system/3CXEventNotificationManager.service.
Removed /etc/systemd/system/3CXIVR01.service.
Removed /etc/systemd/system/multi-user.target.wants/3CXQueueManager01.service.
Removed /etc/systemd/system/multi-user.target.wants/3CXCallFlow01.service.Removed /etc/systemd/system/multi-user.target.wants/3CXSystemService01.service.
Removed /etc/systemd/system/multi-user.target.wants/3CXEventNotificationManager.service.
Removed /etc/systemd/system/multi-user.target.wants/3CXIVR01.service.
Removed /etc/systemd/system/multi-user.target.wants/3CXPhoneSystemMC01.service.
Removed /etc/systemd/system/multi-user.target.wants/3CXPhoneSystem01.service.
Removed /etc/systemd/system/multi-user.target.wants/3CXHotelModule01.service.
Removed /etc/systemd/system/multi-user.target.wants/3CXTunnel01.service.
Removed /etc/systemd/system/multi-user.target.wants/3CXMediaServer.service.
Removed /etc/systemd/system/multi-user.target.wants/3CXCfgServ01.service.
Removed /etc/systemd/system/multi-user.target.wants/3CXAudioProvider01.service.
Removed /etc/systemd/system/3CXPhoneSystemMC01.service.
Removed /etc/systemd/system/3CXPhoneSystem01.service.
Removed /etc/systemd/system/3CXHotelModule01.service.
Removed /etc/systemd/system/3CXTunnel01.service.
Removed /etc/systemd/system/3CXMediaServer.service.
Removed /etc/systemd/system/3CXCfgServ01.service.
Removed /etc/systemd/system/3CXAudioProvider01.service.
Failed to connect to bus: No such file or directory
Failed to connect to bus: No such file or directory
Failed to connect to bus: No such file or directory
Failed to connect to bus: No such file or directory
Failed to connect to bus: No such file or directory
Failed to connect to bus: No such file or directory
Failed to connect to bus: No such file or directory
Failed to connect to bus: No such file or directory
Failed to connect to bus: No such file or directory

Hi,
I can not reproduce it. It looks like a permissions problem.
How did you start the container?
What operating system you are using as a host?
Which is the version of the docker?
Are Apparmor or SELinux enabled on the host?
Regards,

I got the same error message on Synology NAS.
Synology NAS uses Apparmor so I included the command:
--security-opt apparmor=unconfined
as suggested by you when running the container but it made no difference.
Docker version is:
Version:           18.09.8
API version:       1.39
Go version:        go1.11
Git commit:        bfed4f5
Built:             Thu Mar 18 02:58:09 2021
OS/Arch:           linux/amd64
Experimental:      false
Please any help will be greatly appreciated.

Running into the same issue, the setup command seems to deregister all the services, I don't get it:
I described the same problem here, with a full log:
https://github.com/mop1987/3cx-Docker/issues/3

Running into the same issue, the setup command seems to deregister all the services, I don't get it:
I described the same problem here, with a full log:
https://github.com/mop1987/3cx-Docker/issues/3

Please follow this issue: https://github.com/ekondayan/docker-3cx/issues/9

Please follow this issue: https://github.com/ekondayan/docker-3cx/issues/9


Add tests

Codecov Report

Merging #185 (7d16e76) into main (d857d01) will increase coverage by 0.49%.
The diff coverage is 25.00%.

@@            Coverage Diff             @@
##             main     #185      +/-   ##
==========================================
+ Coverage   67.50%   68.00%   +0.49%
==========================================
  Files          14       14
  Lines        1468     1472       +4
==========================================
+ Hits          991     1001      +10
+ Misses        370      364       -6
  Partials      107      107

Impacted Files
Coverage Δ

annotation.go
78.57% <25.00%> (-21.43%)
:arrow_down:

procmon.go
100.00% <0.00%> (+3.84%)
:arrow_up:

procmon_linux.go
69.69% <0.00%> (+4.54%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d857d01...7d16e76. Read the comment docs.


reorganization of the repository

@vkt1414 let me know if you think something should be done differently.
Closing #29

Should we also create a tag/release prior to merging this PR, just in case?

Should we also create a tag/release prior to merging this PR, just in case?

Yes, why not!


[BEAM-9421] Add Java snippets to NLP documentation.

This is a followup to https://github.com/apache/beam/pull/11776

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Choose reviewer(s) and mention them in a comment (R: @username).
[x] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

R: @aaltay can you take a look at this?

Changes preview: https://apache-beam-website-pull-requests.storage.googleapis.com/12453/documentation/patterns/ai-platform/index.html

LGTM. I can merge if there are not additional comments. Could you review the failing test?
@lakshmanok @datancoffee @santhh - Do you have additional feedback on this PR?

Run Java PreCommit

I noticed we are missing tests. Should we add any tests to SnippetsTest.java for the new snippets?

@aaltay I think testing this would increase test time and introduce risk of flakes - the cloud language analysis results aren't very reliable (since the ML model underneath can change) - the most we could test would be if the pipeline is correct, running and returns anything.

@aaltay I think testing this would increase test time and introduce risk of flakes - the cloud language analysis results aren't very reliable (since the ML model underneath can change) - the most we could test would be if the pipeline is correct, running and returns anything.

Snippet tests are not meant to be integration tests, but more like a way to check that snippets are still executable over time.  Anything we can test without actually making a round trip to the service? If that is not possible, let's skip tests.

Snippet tests are not meant to be integration tests, but more like a way to check that snippets are still executable over time. Anything we can test without actually making a round trip to the service? If that is not possible, let's skip tests.

In this case let's skip it, since I don't think it's possible to test something without calling the service.


KAFKA-8238: adding number of messages/bytes read

More detailed description of your change,
if necessary. The PR title and PR message become
the squashed commit message, so use a separate
comment to ping reviewers.
Summary of testing strategy (including rationale)
for the feature or bug fix. Unit and/or integration
tests are expected for any behaviour change and
system tests should be considered for larger changes.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

@dajac , @stanislavkozlovski, @ijuma  I was closing out on some old PRs of mine and found this one. Do you think this is still useful or should I just close it?


appveyor: attempt to build and dist 32 and 64bit archs

should be able to use env variable PYTHON_ARCH to fetch current architecture. ref: https://github.com/ogrisel/python-appveyor-demo/blob/master/appveyor.yml#L18

if appveyor CI passes, and files appear in S3, need to update links in readme


Run button should also allow to debug

open a python program
set a breakpoint
press the run button in the editor toolbar to run the program. Program runs, but doesn't stop at the breakpoint.
Would be cool if that worked too.

Right now the user needs to go through the 'Run' view to do this.

Duplicate of #11812


[foldgutter] reuse old markers if indicatorOpen/Folded is string

On large documents foldgutter spends a lot of time (0.2s, 0.5s, or even a second) unnecessarily forcing CodeMirror to recreate the unchanged mark elements:

With this PR on a large document we'll spend 10+ times less on folding+rendering:

The built-in indicator element for open/folded states differs only by its className so we can optimize for this case. This PR leaves the old marker unchanged if its className contains the new class.

With a user-provided element the only case we can optimize for is to skip removing the marker when there were none. Such a check is implemented in this PR.

classTest function was copied from /src/util/dom.js because AFAICT we can't use classList.contains in some browsers still supported by CodeMirror.

Looks good. Why did you move the ++cur statement? It doesn't look like the old approach would change anything about the code.

I moved it because I've added several early returns so I had to start with from - 1 as well. I still think this is the shortest solution.

That makes sense. Thanks.


Manage Application Page

Description:

Suggested Labels:

Suggested Assignees:

Affected Product Version:
OS, DB, other environment details and versions:
Steps to reproduce:
Related Issues:

This UI has been implemented for APIM 3.0.0 m35.


Cycles in Java classes cause infinite loop in ModelAttributeParameterExpander

When using JPA, Hibernate, and other ORMs, it's common for each side of a relationship to refer to the other. For example:
class Person {
	private String firstName;
	private String lastName;
	private Address address;

	public String getFirstName() {
		return firstName;
	}

	public void setFirstName(String firstName) {
		this.firstName = firstName;
	}

	public String getLastName() {
		return lastName;
	}

	public void setLastName(String lastName) {
		this.lastName = lastName;
	}
	public Address getAddress() {
		return address;
	}

	public void setAddress(Address address) {
		this.address= address;
	}
}

class Address {
	private String street;
	@ApiModelProperty(hidden = true)
	private Person person;

	public String getStreet() {
		return street;
	}

	public void setStreet(String street) {
		this.street = street;
	}
	public Person getPerson() {
		return person;
	}

	public void setPerson(person person) {
		this.person= person;
	}
}

Currently, this set of classes causes an infinite loop resulting in a StackOverflowError in com.mangofactory.swagger.readers.operation.parameter.ModelAttributeParameterExpander.expand(String, Class<?>, List). The problem is that the Java classes are expanded but the annotation which would cause the field to be excluded is being processed, so Person references Address references Person... and the expansion continues infinitely.
I think the solution is to simply process @ApiModelProperty(hidden = true) annotations at expansion time. It may also be nice to detect when such cycles occur and throw a descriptive error (instead of getting a StackOverflowError) but that's just a nice to have... solving the problem would quite sufficient :-)
Thanks!

@candrews I suspect this may be a bug. Will take a look, but most likely its going to be fixed in 2.x

The team here and I are very psyched about using Swagger, and this issue is a blocker for us, so I have to ask - what's the timeline for 2.x?
Also, my naive impression is that if a check for the @ApiModel(hidden=true) annotation on the "field" variable in the "expand" method would solve this problem and doesn't seem like it could cause regressions, so is that solution workable, and would it be permitted in a near future non-2.x release?

Well its really close :) but i'll say at least 2 weeks before a public snapshot/release. Let me see if I can fix it in 1.0.2.

Having said that, I'd say a couple things

the new 2.0 the api will have changed a little bit (as regards SwaggerSpringMvcPlugin and is set up to support multiple service description formats, swagger 1.2 and swagger 2.0 are supported out of the box, with plans to support more formats on the way.
secondly all the swagger annotations will be supported across both those versions.

we shouldn't rely on an annotation as a means to break the cycle.

@candrews Out of curiosity why are these deep domain objects annotated with @ModelAttribute?

I'm using them in controller methods, ex:
@Controller
public class AddressService {
   	@Autowired
	private AddressService addressService;

	@ModelAttribute("address")
	public Address getAddress(@PathVariable int addressId) {
		return addressService.getById(addressId);
	}

	@RequestMapping(value = "/address/{addressId}", method = RequestMethod.POST)
	@ResponseBody
	public Address updateById(@PathVariable int addressId,
			@Valid @ModelAttribute("address") Address address) {
		return addressService.update(degree);
	}
}

There are a lot more methods (getting, updating, deleting, then using views/templates for html rendering, etc) but that's the basic idea. I think that's a pretty common approach. (Using view objects distinct from the entities seems to be a common alternative, but this pattern seems to work fine, too.)

@candrews It seems like its a lot harder to fix it that I had anticipated in 1.x, especially since I suspect you're expecting that Person is ignored in the Address object. Its a little simpler in 2.0 work we've been doing.
Unfortunately, I think it makes more sense for use to focus our efforts on getting 2.x out.

This should now be fixed in 2.0

This doesn't appear to be fixed, I tried versions 2.0.1 - 2.1.1, the only versions I could try before the need for spring 4. I have the same setup, where entities reference one another, I applied the @ApiModelProperty(hidden = true) but I still get an endless stream of :
2016-01-08 12:47:52,601 [localhost-startStop-1] DEBUG springfox.documentation.spring.web.readers.parameter.ModelAttributeParameterExpander- Attempting to expand expandable field:
2016-01-08 12:47:52,601 [localhost-startStop-1] DEBUG springfox.documentation.spring.web.readers.parameter.ModelAttributeParameterExpander- Expanding parameter type:
ending in stackoverflow here:
springfox.documentation.spring.web.readers.parameter.ModelAttributeParameterExpander.expand(ModelAttributeParameterExpander.java:84)

@cm325 could you please try with 2.3.1 that is spring 3 compatible again

If not please open a :bug:

Hi, yes, sry, I just edited my comment to include the fact that I just saw that 2.3.1 is spring 3 compatible, and just tested with that as well, and unfortunately, the same error occurs. I will open new bug-

👍🏼 would be useful if u can provide a failing model or better still a
failing test.
On Fri, Jan 8, 2016 at 12:25 PM chris marx<EMAIL_ADDRESS>wrote:

Hi, yes, sry, I just edited my comment to include the fact that I just saw
that 2.3.1 is spring 3 compatible, and just tested with that as well, and
unfortunately, the same error occurs. I will open new bug-
—
Reply to this email directly or view it on GitHub
https://github.com/springfox/springfox/issues/621#issuecomment-170081664
.

I just posted this -
https://github.com/springfox/springfox/issues/1133
hoping that will be enough-

help me .


Add Lumina - Transforming Text into Any Modality

a series of text-conditioned Diffusion Transformers (DiT) capable of transforming textual descriptions into vivid images, dynamic videos, detailed multi-view 3D images, and synthesized speech.
Code - https://github.com/Alpha-VLLM/Lumina-T2X

there's a lot of residual noise reported with the model, needs to be tested before addition


Crop by mask can preserve alpha channel

Crop by mask must convert image to RGB
If input image is RGBA, the alpha will lost.
Can check input shape and convert to RGBA if 4 channels?
I can workaround by adding extra node to combine RGB and mask again, but it'll be more convenient to preserve the same channels as input.
https://github.com/chflame163/ComfyUI_LayerStyle/blob/3050915d490e4b8f77f1c6fd3f9b6d488e090d8f/py/crop_by_mask_v2.py#L98

The cropped mask output has been provided, you only need to add one node to merge them.

This is my current workaround, but if it preserve the alpha channel then can simplify the workflow.
Just simply change the line to
_canvas = tensor2pil(l_images[i]).convert('RGBA' if l_images[i].shape[3] == 4 else 'RGB')

This is my current workaround, but if it preserve the alpha channel then can simplify the workflow. Just simply change the line to

Yes, you can do it this way. However, users who previously used nodes may receive tensor outputs of different dimensions, which could lead to unexpected issues, so I do not intend to modify it :）

ok


Turning MIBiG on in BiG-SCAPE run of NPLinker

I noticed that MIBiG is turned off in the NPLinker BiG-SCAPE run, was this done for a particular reason? Because I think it would make a lot more sense to include it by default.
I think it would just be setting mibig_14=True here:
https://github.com/sdrogers/nplinker/blob/e7b79c19771dee4f4a4353309ccab1dcb7b4a55d/prototype/nplinker/pairedomics/runbigscape.py#L26
This will run into this if statement:
https://github.com/sdrogers/nplinker/blob/e7b79c19771dee4f4a4353309ccab1dcb7b4a55d/prototype/nplinker/pairedomics/runbigscape.py#L63-L64
Meaning the --mibig flag will turned on which will use the newest version of MIBiG (2.1). I don't precisely know how the downloading of the compressed MIBiG file happens, maybe this needs to be adjusted as well to include the newest version.
Cheers,
Joris

was this done for a particular reason?

If you're reading through the NPLinker code and find anything that makes you ask this question, the answer will probably be "because I didn't know any better" :)
I just don't have the background to know what makes sense in a lot of these instances. If I remember correctly I had a script from somewhere that was used to run BiG-SCAPE and simply copied the parameters it used. This was a while ago as you can see from the way "mibig_14" is linked to the "--mibig" parameter when that now actually means "use MiBIG 2.1".
You should already be able to add this parameter using the "extra_bigscape_parameters" option in the NPLinker config file, but if it would make more sense to have it enabled as a default I'll do that and update the documentation to match.

I think it would make more sense to add it by default! Or at least to add a line somewhere explicitly stating that you need to turn on MIBiG when running bigscape, as I think almost everyone wants to use MIBiG as well when using bigscape.
Thanks :)

OK, no problem. This should be fixed by commit 457646577ea722a99a41c1458ecafc13e5b7ad2b, and is included in the v1.1.1 Docker image I'll upload shortly. I've also updated the default config file to indicate --mibig is the default.

Sorry - bit late to this. Don’t have a particularly strong preference, but the reason I think why it was off by default is that including 2000 extra data observations into a cluster analysis with (most likely) fewer than 2000 original observations massively biases the results. When looking at using MIBIG we generally felt that the known cluster blast way of incorporating made much more sense.
As long as it’s easy to turn on and off and the docs are clear, it doesn’t matter, but just for context….

I'll add a bit more emphasis around that in the documentation then, sounds like something people will want to be aware of when they try NPLinker for the first time.

But the MIBiGs are not taken into account in any of the analyses right? They are just added in the GCF as additional info? Or am I mistaken here?

@sdrogers thanks for your thoughts on this - it makes sense to not include them when running a small amount of BGCs, but rather compare afterwards which experimental BGCs match to the MIBiG ones. @louwenjjr if added, they are also part of the clustering analyses! Thus, when you do not have quite some experimental BGCs, they will hugely influence the clustering.

I'm not sure I follow completely, please correct me if I miss something of course. But I still don't see why adding the MIBiGs would hugely affect a BiG-SCAPE run with few experimental BGCs, as BiG-SCAPE just constructs a distance matrix right? And then it uses some graph clustering akin to dbscan to group connections into clusters in the best way possible if they are below a cutoff. In theory I think it could perhaps be possible that because a MIBiG BGC is added, two experimental BGCs are put together in a cluster because of their connection to a MIBiG, but this seems like valid information to me. Afterwords MIBiGs are removed from the output that are not included in any GCFs, and then NPLinker only takes MIBiG information into account in the annotations right? So how could adding MIBiG massively influence the results?

Ultimately, the BGCs that are included in the clustering will determine the clustering. Consider two non-MiBIG BGCs…whether or not they are in the same cluster will potentially change depending on whether or not you include 2000 from MiBIG. In addition, each MiBIG can only appear in a single cluster, so you will almost certainly end up with situations where a measured BGC has high similarity to an MiBIG, but it doesn’t get clustered together because the MiBIG has higher affinity to another cluster. I.e. there is a really unpredictable effective limit to the number of things that will end up being annotated with an MiBIG, and it seems really odd to me that whether or not BGC A ends up being similar to MiBIG X changes depending on the presence of BGC B. It’s all just too unstable for my taste.
If you want to compare measured BGCs with MiBIGs, known cluster blast seems a way better solution. However, it’s ultimately up to each user to so as long as it’s clearly documented….

@justinjjvanderhooft I would have thought that MiBIG dominates a lot of analyses because many datasets don’t have close to 2000 measured BGCs? Although as time goes on, datasets will probably get bigger quicker than MiBIG will.

@sdrogers it will depend on how many MIBiG BGCs actually match to experimental ones. As the MIBiG database is quite biased in terms of organisms and type of clusters (and will remain to be in the coming time), the impact on the clustering will depend on multiple factors including size of the dataset but also the type of samples.

I think good documentation is then indeed nice.

I.e. there is a really unpredictable effective limit to the number of things that will end up being annotated with an MiBIG, and it seems really odd to me that whether or not BGC A ends up being similar to MiBIG X changes depending on the presence of BGC B

I do think that what you describe still does not matter for the clustering of the experimental BGCs right? It might indeed be that a MIBiG will end up in one of the two GCFs in the scenario you describe, but this does not have any effect on the clustering of the experimental BGCs, just the annotation of them. So indeed, ideally you might want to have this MIBiG included in both GCFs, but including the MIBiGs will give additional annotation information albeit not perfect.
And then also based on Justin's comment, and also based on my experience with BiG-SCAPE, not many MIBiGs end up in the GCFs anyway (especially with 0.3 cutoff) since the experimental BGCs will just differ quite a bit from what is present in MIBiG.

Well, if MIBiG BGCs are added as BGCs to cluster, the situation Simon describes may happen, but I would also say that it is not that likely to occur....

@louwenjjr if MIBiG is included then the concept of “clustering of the experimental BGCs” isn’t a thing. It’s a clustering of everything. With instance based cluster methods (as opposed to, eg statistical mixtures), the addition / removal of a single BGC can change the resulting clustering profoundly.
I agree with @justinjjvanderhooft in that MIBiG is (naturally) biased and so many of its entries may well have no affinity with the experimental BGCs in any particular experiment. But my main point stands: including MIBiG will change the relationships that bigscape extracts between experimental BGCs wrt what they would be if it wasn’t included, and it does so in a way that is unpredictable. Affinity clustering on its own is pretty unpredictable, but that’s a whole other story….:-)
Using the known cluster blast feature doesn’t have any of these problems. And I don’t see any output that adding MIBiG to the clustering can provide that known cluster blast cannot?

@sdrogers I think we all agree and I think it is a matter of taste what the best default option is. In the end, all clustering is subjective....;-) - let's indicate this well in the documentation and in the future also further support the use of knownclusterblast (and "substructureblast") annotations....


CTD interacting with RFTools powercell

https://gist.github.com/xenoflot/16ed83d032b21d2a6c50525cd3983119
Player on the server had switched to SSP to test the powercell linking and CTD.
I don't know the specifics of what he did, but I expect it wasn't much more than spawning in a generator and some powercells. Please let me know if the crashlog doesn't have enough information and I'll do some testing to narrow it down.
I first reported this to McJty and he advised: "It is trying to send RF into the powercells on client side!"
advancedrocketry-1.10.2-1.0.6
compatlayer-1.10-0.1.7
mcjtylib-1.1x-2.3.2
rftools-1.1x-5.81
libvulpes-1.10.2-0.1.13-universal
Cheers!

Looks like I missed an isRemote check.  Will fix when I get to my computer.

Thanks for the quick reply! Much appreciated.


 I'm bored at work so let's get the ball rolling!
Today's Victim is ... *drum roll*
CarbonRange.php
According to the https://github.com/sylae/armbreaker/commit/3b46958d17b49580287bddd5dbc01ac067778944 commit!
<?php
/*
 * Copyright (c) 2018 Armbreaker Developers.
 * Use of this source code is governed by the MIT license, which
 * can be found in the LICENSE file.
 */

Yay! You adopted this! Nice! Less bloat, less file size and still gets the license across!
So as I see it this file is just a helper class than an actual Integral part of Armbreaker. The directory structure suggests so... So let's talk about directory structures!
Amazing segway is amazing!
Right now all your files are on a single level structure, which isn't bad for a small application. Especially if it remains simple... but very few applications remain so and a flat structure scales very poorly.

You can see from that image that even that is a bit overwhelming and it's not even a single level structure! imagen if all the related files would be in the same folder! more than 900+ files in a single folder! it would be a nightmare managing that!
So usually developers break these up into subfolders, according to their function:

web controllers, which serve the web hos are usually called Controller get into a folder called Controllers
Models or entities which ever you prefer, class that hold data and work with a set of data gets their own folder as well called Models or Entities again which ever you prefer
Class that deal with a Collections of Models or Entities are usually called Collections, but I see it already used here. I have seen two subfolders usually: inside the Models folder as a subfolder or a folder beside the Models.
Utility class or Helpers, the classes that just make some things easier for you to deal with like this class, get their own subfolder called Utility or Helpers
Templates, Views, pages, basically HTML building blocks get their own folders that can be from the name of the templating engine to simply naming it page

So yeah most projects have some logical folder structure so it can organize better. Of course, if you are using PSR-4 (which you should, and do) your namespacing should be updated accordingly. Sure the use statements gonna be longer, but your code base gonna be more organized and easier to look through, which is a win-win!
So yeah, let's move on!
    /**
     * Parse a new date and recalc the min/max
     * @param \Carbon\Carbon $new
     */
    public function addDate(\Carbon\Carbon $new)

Noice! comment block, way to go! Allri-
public function addRange(CarbonRange $new)

...no comment block here why? sure its does something similar to the previous, but what's the difference? commenting can help...
    public function atomEarliest(): ?string
    {
        if ($this->earliest instanceof \Carbon\Carbon) {
            return $this->earliest->toAtomString();
        }
        return null;
    }
    public function atomLatest(): ?string
    {
        if ($this->latest instanceof \Carbon\Carbon) {
            return $this->latest->toAtomString();
        }
        return null;
    }

and these are the biggest offenders...

no comment block on what it does
function name is not clear.
What does this function do? atomEarliest? does it set? or get? if i look at the return type ?string it's a nullable string which is ok... but i had too look at the function's implementation to get that info. why cant i get it from its name? let it be getAtomErliest and from that you know it will give back something!
You are checking the type now? When you return? if you need to check then check it when you get the data! So you are sure you are working with the data you need to work, not when you already return with the worked data! What if íou worked so far with the wrong type, but has the same Interface implemented (aka it could work with it, and not fail) yet cant return because its not the type you want? Check in the setters(addDate, addRange, not in getters!

and... that's about it! I will come back later with a new Code review! Until then Sayonara!

Forgive need senpai I'm on mobile and dying.

You are checking the type now? When you return? if you need to check then check it when you get the data! So you are sure you are working with the data you need to work, not when you already return with the worked data! What if íou worked so far with the wrong type, but has the same Interface implemented (aka it could work with it, and not fail) yet cant return because its not the type you want? Check in the setters(addDate, addRange, not in getters

This should probably be an is_null check, really it's just a helper to avoid a bunch of temp vars and checking code in the actual json exporting. That's here because a CarbonRange will hit lots of instances where there are zero dates in the range (therefore earliest and latest aren't set).

Then I recommended creating a constructor and set earliest and lates to null there, leave the setters as is. and when you call the getters, you can be pretty sure that its ether null or one of the carbon object and is_null ora simple if ($this->latest) is enough for that.


[REQUEST] Support for claim enter / exit for respawn after death.

Feature information
Currently if a player dies in claim, once they respawn claim-exit events do not get triggered does not triggered. This includes both claimfarewell and option player-exit-command do not trigger. I think that a respawn after death event should be considered a move that triggers claim exit.

This has been implemented in latest development builds.

This has been implemented in latest development builds.


URLCoder error when using driver with streamsets

I'm using crate-jdbc as the driver of a JDBC Producer in StreamSets and I cannot get past the following error:
JDBC_00 - Cannot connect to specified database: com.zaxxer.hikari.pool.PoolInitializationException:
Exception during pool initialization: Could not initialize class io.crate.shade.org.postgresql.util.URLCoder

the JDBC url looks like this: crate://<IP_ADDRESS>:4300/doc.
Any idea why the URLCoder class could be failing to load?
Thanks

This looks strange, I have no real clue how the static UrlCoder class can run into initialization errors (Nothing error-prone is done on the static initialization).
The only thing I see is that you maybe using the wrong port, 4300 by default is used by the inter-node communication (transport port). The default PGSQL/JDBC port is: 5432.

Ok, 5432 makes sense, indeed. This[1] guide I was following said 4300 though, so I wasn't sure what port to use.
However, I'm running another Postgre server in the same machine. Crate seems to be picking 5433 for its psql service instead.
BTW, the streamsets pipeline is meant to load records from that Postgre server into Crate. I first suspected a JAR version conflict between the two JDBC drivers could be causing the problem. But the crate driver contains a shaded pg driver, so I guess it shouldn't cause trouble.
[1] https://crate.io/docs/crate/guide/en/latest/tools/streamsets.html

Ok so this issue is now solved by using the right port?
We will update our Streamsets guide asap, thanks for pointing this out!
If there is still an issue, feel free to re-open this.


Not working on Windows 11

When I click on new player, then click register, it simply says: "Couldn't connect to the search service. Please try again in a bit."
Brainwine runs for about half a second and then quickly disappears. I am not able to run the Brainwine GUI. I have tried using the host.reg, but it does not work when I retry either.
I have Java 8, I have dragged the "Assembly-CSharp.dll" file into the Managed folder.
Please help me out, I really want to play this game again.

Does anything of note happen when trying to run it? Are you using the latest version?

Hi there, Brainwine is running now. But it is still saying "Couldn't connect to the search service. Please try again in a bit." whenever I register for a new deepworld account (I know you can't use your old account)

Also yes, I am using the latest version.

Do you know why this might be? Brainwine started running properly once I switched browsers. (Microsoft Edge to Google Chrome) and then I redownloaded the jar file and zip folder from chrome, that's when Brainwine started running without any issues. Now it is just the error message I get when creating a new user for Deepworld.

Make sure that the server is actually running and that you start the game through the brainwine GUI

I have been using the brainwine gui to start deepworld. Do you know how I can make sure the server is actually running? I put both gateway and api host on "local" but it's still not working.

There is a “server” tab in the GUI.

I tried that, it says: "2023-05-01 08:19:17.276 ERROR - An unexpected exception occured
java.lang.reflect.InvocationTargetException: null
at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:119) ~[?:?]
at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?]
at io.javalin.core.LoomUtil.getExecutorService(LoomUtil.kt:22) ~[brainwine.jar:?]
at io.javalin.jetty.LoomThreadPool.(JettyUtil.kt:90) ~[brainwine.jar:?]
at io.javalin.jetty.JettyUtil.defaultThreadPool(JettyUtil.kt:28) ~[brainwine.jar:?]
at io.javalin.jetty.JettyUtil.getOrDefault(JettyUtil.kt:20) ~[brainwine.jar:?]
at io.javalin.jetty.JettyServer.server(JettyServer.kt:34) ~[brainwine.jar:?]
at io.javalin.Javalin.start(Javalin.java:180) ~[brainwine.jar:?]
at io.javalin.Javalin.start(Javalin.java:148) ~[brainwine.jar:?]
at brainwine.api.GatewayService.(GatewayService.java:41) ~[brainwine.jar:?]
at brainwine.api.Api.(Api.java:34) ~[brainwine.jar:?]
at brainwine.ServerThread.run(ServerThread.java:32) ~[brainwine.jar:?]
Caused by: java.lang.UnsupportedOperationException: Preview Features not enabled, need to run with --enable-preview
at jdk.internal.misc.PreviewFeatures.ensureEnabled(PreviewFeatures.java:49) ~[?:?]
at java.lang.Thread.ofVirtual(Thread.java:859) ~[?:?]
at java.util.concurrent.Executors.newVirtualThreadPerTaskExecutor(Executors.java:274) ~[?:?]
at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?]
... 11 more"

Well that’s stupid. Try using an older Java version, like 17.

ok thank you so much I will let you know if it works

ok I tried using java 17 but it is just doing what i said it was doing at the beginning of this issue again. :/

now brainwine won't run again

when i try running brainwine, a small black rectangle pops up on my desktop for about half of a second or less, and there is no text that shows up or anything.

is there anything I am doing wrong? does it matter that my laptop is an MSI?

Hard to say. You could try to "run as" and then try every Java thing, if there are multiple.

sorry for late reply but still not working.

sorry for late reply but still not working.

It might be worth to create a batch script or open a command prompt in the same directory as brainwine.jar and running
java -jar brainwine.jar to see what might be going wrong.

I wish I knew what that meant. Are you able to give me step by step instructions ?

I wish I knew what that meant. Are you able to give me step by step instructions ?

Open the folder where brainwine.jar is located
Click on the location bar (the wide bar right above the file list)
Clear all the text in it and type cmd and press enter
A command prompt (small black window) should appear
Type java -jar brainwine.jar in the command prompt and press enter
Tell me what happens, and any errors that occur

Open the folder where brainwine.jar is located Click on the location bar (the wide bar right above the file list) Clear all the text in it and type cmd and press enter A command prompt (small black window) should appear Type java -jar brainwine.jar in the command prompt and press enter Tell me what happens, and any errors that occur

Error: Unable to access jarfile brainwine.jar
C:\Users\caina\OneDrive\Desktop\brainwine>

I tried that, it says: "2023-05-01 08:19:17.276 ERROR - An unexpected exception occured java.lang.reflect.InvocationTargetException: null at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:119) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.javalin.core.LoomUtil.getExecutorService(LoomUtil.kt:22) ~[brainwine.jar:?] at io.javalin.jetty.LoomThreadPool.(JettyUtil.kt:90) ~[brainwine.jar:?] at io.javalin.jetty.JettyUtil.defaultThreadPool(JettyUtil.kt:28) ~[brainwine.jar:?] at io.javalin.jetty.JettyUtil.getOrDefault(JettyUtil.kt:20) ~[brainwine.jar:?] at io.javalin.jetty.JettyServer.server(JettyServer.kt:34) ~[brainwine.jar:?] at io.javalin.Javalin.start(Javalin.java:180) ~[brainwine.jar:?] at io.javalin.Javalin.start(Javalin.java:148) ~[brainwine.jar:?] at brainwine.api.GatewayService.(GatewayService.java:41) ~[brainwine.jar:?] at brainwine.api.Api.(Api.java:34) ~[brainwine.jar:?] at brainwine.ServerThread.run(ServerThread.java:32) ~[brainwine.jar:?] Caused by: java.lang.UnsupportedOperationException: Preview Features not enabled, need to run with --enable-preview at jdk.internal.misc.PreviewFeatures.ensureEnabled(PreviewFeatures.java:49) ~[?:?] at java.lang.Thread.ofVirtual(Thread.java:859) ~[?:?] at java.util.concurrent.Executors.newVirtualThreadPerTaskExecutor(Executors.java:274) ~[?:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] ... 11 more"

The error you originally had should've been solved with the latest release. Try running it with the Java version you originally used: https://github.com/kuroppoi/brainwine/releases/latest

it keeps wanting me to "Open with" but I don't know what to select.

I tried that, it says: "2023-05-01 08:19:17.276 ERROR - An unexpected exception occured java.lang.reflect.InvocationTargetException: null at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:119) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.javalin.core.LoomUtil.getExecutorService(LoomUtil.kt:22) ~[brainwine.jar:?] at io.javalin.jetty.LoomThreadPool.(JettyUtil.kt:90) ~[brainwine.jar:?] at io.javalin.jetty.JettyUtil.defaultThreadPool(JettyUtil.kt:28) ~[brainwine.jar:?] at io.javalin.jetty.JettyUtil.getOrDefault(JettyUtil.kt:20) ~[brainwine.jar:?] at io.javalin.jetty.JettyServer.server(JettyServer.kt:34) ~[brainwine.jar:?] at io.javalin.Javalin.start(Javalin.java:180) ~[brainwine.jar:?] at io.javalin.Javalin.start(Javalin.java:148) ~[brainwine.jar:?] at brainwine.api.GatewayService.(GatewayService.java:41) ~[brainwine.jar:?] at brainwine.api.Api.(Api.java:34) ~[brainwine.jar:?] at brainwine.ServerThread.run(ServerThread.java:32) ~[brainwine.jar:?] Caused by: java.lang.UnsupportedOperationException: Preview Features not enabled, need to run with --enable-preview at jdk.internal.misc.PreviewFeatures.ensureEnabled(PreviewFeatures.java:49) ~[?:?] at java.lang.Thread.ofVirtual(Thread.java:859) ~[?:?] at java.util.concurrent.Executors.newVirtualThreadPerTaskExecutor(Executors.java:274) ~[?:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] ... 11 more"

The error you originally had should've been solved with the latest release. Try running it with the Java version you originally used: https://github.com/kuroppoi/brainwine/releases/latest

it keeps wanting me to "Open with" but I don't know what to select.

Java, OpenJDK, whichever you have.

Open the folder where brainwine.jar is located Click on the location bar (the wide bar right above the file list) Clear all the text in it and type cmd and press enter A command prompt (small black window) should appear Type java -jar brainwine.jar in the command prompt and press enter Tell me what happens, and any errors that occur

Error: Unable to access jarfile brainwine.jar
C:\Users\caina\OneDrive\Desktop\brainwine>

This is strange. Are you sure that brainwine.jar is in there?
Maybe try completely re-installing Java. Doesn't have to be Java 8, Java 17 should work as well.

Inactive


[Do Not Review Reference Only] Remove Site and Region FKs from model classes and enforce Location FK not null.

Closes: #2957
What's Changed

TODO

[ ] Explanation of Change(s)
[ ] Added change log fragment(s) (for more information see the documentation)
[ ] Attached Screenshots, Payload Example
[ ] Unit, Integration Tests
[ ] Documentation Updates (when adding/changing features)
[ ] Example Plugin Updates (when adding/changing features)
[ ] Outline Remaining Work, Constraints from Design

see https://github.com/nautobot/nautobot/pull/3195 for the reopened PR


Support for pruned scan for required fields.

https://github.com/databricks/spark-csv/issues/166
Firstly,
I tested the pure iteration time of produced RDD from buildScan() with lineitem table in TPC-H.
On local machine, I set the number of 100,000 rows and measure the time.
The result was below. (The total number of columns was 17)

Scan Type
Required Fields
Elapsed Time

PrunedScan
C0
0.106

PrunedScan
C0, C1, C2, C3, C4, C5, C6
0.287

PrunedScan
* (C0 - C16)
0.505

TableScan
C0
0.536

TableScan
C0, C1, C2, C3, C4, C5, C6
0.502

TableScan
* (C0 - C16)
0.489

Secondly, I didn't add test codes separately since the original test codes cover this.
Could you review this please?

Current coverage is 85.56%

Merging #169 into master will decrease coverage by -1.01% as of a5c0325

@@            master    #169   diff @@
======================================
  Files           10      10
  Stmts          447     485    +38
  Branches       137     147    +10
  Methods          0       0
======================================
+ Hit            387     415    +28
  Partial          0       0
- Missed          60      70    +10

Review entire Coverage Diff as of a5c0325

Powered by Codecov. Updated on successful CI builds.

Cool! I'll take a closer look at this tomorrow.

@HyukjinKwon Thanks for adding this feature. I left some comments, mostly regarding style and readability.

@falaki Thanks for your advices. I updated them.
Also, I changed requiredIndices.update(requiredFields.indexOf(field), index) to requiredIndices(requiredFields.indexOf(field)) = index,
and java.text.ParseException to java.text.ParseException if dropMalformed => which I think I removed  by mistake while testing.


Update changelog

We should update https://github.com/aws-cloudformation/aws-cfn-lint-visual-studio-code/blob/master/CHANGELOG.md, because 1) it's visible in the VS marketplace, and 2) people like seeing what changed between versions (at least I do)

tracking in https://github.com/aws-cloudformation/aws-cfn-lint-visual-studio-code/pull/111


feature: Add Kotlin Coroutines support

Add Kotlin coroutines support for  WebFlux/Kotlin project(replace the reactive DataFetcher with Kotlin coroutines),  and the following cases in a Kotlin project(both MVC and WebFlux).

DataLoader
Subscription Handler

I did some investigation into this, part of this work would require us to be able to supply a coroutine context as well since WebFluxSecurity context will probably need to be injected. GraphQL-Kickstart has this implemented https://github.com/graphql-java-kickstart/graphql-java-tools/blob/b6cfd647a6ded1b7f38a04a7fd2d9ea3b0287a7b/src/main/kotlin/graphql/kickstart/tools/resolver/MethodFieldResolver.kt#L194 but we might want to abstract the field resolvers in the dgs framework code to be more re-usable objects. Just my 2-cents. (I can also provide an example project if need be on how graphql-kickstart did this).

Basic support added in #472. Please try it out and review!

Merged in #472

Is there a Kotlin Coroutines based DataLoader ?


5.62: Random game loading crashes happen in different scenarios

We have had several inconsistent crash reports from game loads in the following scenarios:

Manually selecting a game
Setting a StartGG tournament
Setting a Challonge tournament
Reloading a game after an asset pack download
Reloading the tournament information
Starting the program with a tournament loaded in

The issue has been confirmed to appear with several games (SSBU, SFV, ARMS)
Log investigation has not proven to be too relevant so far.

This is in relation to asset swapping between games and tournaments that was caused by the mutex unlock issue that has been addressed for quite a while.


2组许观

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


broken looking focus border on interaction / navigation

when embedding a powerbi report via the package we see a weird black outline on load and whenever we navigate within the powerbi report. this looks different to the regular focus outline that is active when tabbing through the powerbi content.
the source for this issue seems to be this css rule:
/* https://content.powerapps.com/resource/powerbiwfe/styles/reportembed.bundle.min.SOMEID.css */
html[data-focus-source=key] .embedWrapper .canvasFlexBox .displayAreaContainer .displayArea .visualContainerHost:focus {
    outline: var(--focus-two-tone-outline-definition,auto 1px)!important;
    outline-color: var(--focus-two-tone-outline-color,-webkit-focus-ring-color)!important
}

example screenshot of the issue:

is this an issue with the react package or the general powerbi-client? how can i disable this (if in the gui possible), or may I send a PR that removes these lines as they look atrocious and serve no real accessibility purpose

The black outline you're experiencing while tabbing through the Power BI content is actually the default behavior of the application. This behavior is consistent on both Power BI Desktop and the Power BI Service.
Feel free to reach out for any other queries.


Display list of versions when using "switch"

A detailed description of the proposed feature
It could be great by doing brew switch name-of-the-formula, it displays the list of versions available.
The motivation for the feature
Sometimes, homebrew tells me to switch to another version but I really do not know what it is installed.
How the feature would be relevant to at least 90% of Homebrew users

What alternatives to the feature have been considered

Please fully fill out the issue template.
We'll consider a PR for this.


Use inline SVGs for Buttons

What is the context of this PR?
This PR changes buttons to use inline SVGs and also changes how print and exit buttons are defined to make it more simple for the user. The "loader" button has not been affected by this change and will be updated in a later PR
How to review
Check all button types look and behave as expected

 Refactor Buttons to use inline SVGs

I'm probably missing something but if all svg code is now held with the svg macro why do we still have individual svg files?

I'm probably missing something but if all svg code is now held with the svg macro why do we still have individual svg files?

Yeah, I'm going to do a mop up PR to remove them

 Refactor buttons to use inline SVGs


ajax comment item template issue

I copied the folder 'APP/plugins/comments/views/elements/comments' into the folder 'APP/views/elements/', so I can change the rendering of comments. This is working fine, when I load a page, comments are displayed and rendered from these files, but when I'm trying to add a new comment via ajax, the comment section reloads and renders the comments from 'APP/plugins/comments/views/elements/comments', not from my folder...

can't confirm, works for me


feat(esl-share): add ability to update config items (single one or in batch)

:tada: This PR is included in version 5.0.0-beta.1 :tada:
The release is available on:

npm package (@beta dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 4.15.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Fix #1077 thankyou message after download click

Fixes #1077

@m-kuhn shows thank you message again. @agiudiceandrea I preferred adding the .reference instead of js correction - let me know if you disagree?

@m-kuhn BTW: seems i cannot edit [Development] section on the right to effectively link this PR to issue #1077 which it should solve. Could I get those rights :) ?

seems i cannot edit [Development] section on the right to effectively link this PR to issue https://github.com/qgis/QGIS-Website/issues/1077 which it should solve. Could I get those rights :) ?

@faebebin just write Fixes #1077 in your message and it will close it + Github will fill the section.

Thanks @faebebin!
A little improvement is maybe to use the "reference external" class for the "OSGeo4W Network Installer" link in order to let the new page open in a new tab (see https://github.com/qgis/QGIS-Website/blob/master/themes/qgis-theme/static/qgis-site.js#L7-L12) and to avoid that the new page covers the old page preventing the overlay text and the donation button to be actually visibile.

@agiudiceandrea thanks for the hint. Will add a followup fix asap.

see #1079


httpstat.us/504 returns a 200

$ curl -sv httpstat.us/504
*   Trying <IP_ADDRESS>...
* TCP_NODELAY set
* Connected to httpstat.us (<IP_ADDRESS>) port 80 (#0)
> GET /504 HTTP/1.1
> Host: httpstat.us
> User-Agent: curl/7.54.0
> Accept: */*
>
< HTTP/1.1 200 OK
< Date: Sat, 30 Oct 2021 05:41:07 GMT
< Content-Length: 0
< Connection: keep-alive
< cache-control: private

Expected behavior would be a 504 HTTP status response.

As expected to previously detected abuse - https://github.com/Readify/httpstatus/issues/89#issuecomment-705978272


Add reactive resolver on tmi event

Bot should send a message to thanks user on sub and follow

For reference https://github.com/tmijs/tmi.js/blob/master/lib/client.js


Remove fused-dense-lib from requirements.txt

This requirement can already be installed with pip install -e .[fused-dense-lib] and is the only requirement that prevents us from installing axolotl without a GPU.

That might be right, but something was installing this dependency in axolotl without me specifying it and thought this might be the issue. Given that it's filtered out anyway, why is it in requirements when it's an extra?

haha, that's a totally valid question! I keep it in requirements.txt so anyone could reasonably see all the potential dependencies. Like we currently keep flash-attn in there as well. I'm not staunch in my position that we should keep it in there, so if you feel that ergonomically we should remove it, I'm fine with that. Ultimately I'd like to move to something like poetry or have it in something like pyproject.toml


videos are not played

PlatformException (PlatformException(VideoError, Video player had error com.google.android.exoplayer2.ExoPlaybackException: Source error, null, null))

.


How to count genotypes with a 10 node Spark/Adam cluster faster than with BCFTools on a single machine?

Hi,
How can I count genotypes in a Adam Genotype parquet file, using a Spark and Adam cluster, faster than doing the same thing  with a BCF file and BCFTools on a single machine?
I am looking into Spark/Adam as a potential back end for a scalable Variant and Genotype store.
As a baseline for performance I used BCFTools to decompress, inflate and count variant/genotype records from the Chr_22 1000 genomes BCF file.
This took 5m7s with a single thread on a single machine. Chr_22 is just a small part of the full 1000 genomes Variant/Genotype data set, which of course includes the other chromosomes.
My expectation was that with a small Spark and Adam cluster this could be done at least an order of magnitude faster. Say below a minute.
To my surprise the best result I can get with a 10 node Spark/Adam cluster is slower than my single machine BCFTools baseline, and that is with using at least 10 times as much resources.
The best results I could get with Spark and Adam is 8m8s. This doesn't even take in to account that I really would like to count (query) variants for which a expensive groupByKey (variant id/pos) is needed.
Am I mistaken to look in to Spark and Adam as potential (future) scalable back end for storing and querying Variants and Genotypes?
Should I look into related technology for setting up a scalable variant and genotype store? For instance SparkSQL or Impala, or something completely else?
Is in memory caching (of compressed Variant&Genotype data?) needed to get good (interactive) query performance?  And would that be possible for the 1000 genomes vcf file which is raw 1TB over all chromosomes? z
Or did I just make some mistakes with the commands somewhere?
My time to count genotypes looks slower than from the performance results mentioned here
http://bdgenomics.org/blog/2015/02/02/scalable-genomes-clustering-with-adam-and-spark/
Count chr22 genotypes (from HDFS):    10 min (2nodes)       1.4 min(20nodes)
The exact code used to start up a Spark and Adam cluster and do the performance comparison with BCF tools is here:
https://github.com/NeillGibson/SparkAdamTest/blob/master/SparkAdamTest.sh
Any comments and insights would be much appreciated.
Best Regards,
Neill Gibson

Thank you for documenting your use case, will take a look.

Thank you!

Hi Michael I had some time to look at the comments and test the changes.  For readability I split the results I found in multiple comment here:

The following paths are the same:
./s3cmd-master/s3cmd
/home/ec2-user/s3cmd-master/s3cmd
The default user in the eggo cluster is ec2-user. After log in to the cluster the working directory is /home/ec2-user/

I tried another vcf2adam conversion and count with your suggested changes.
hadoop fs -mkdir  /user/ec2-user/test_18_11_2015
zcat /home/ec2-user/1kg/ALL.chr22.phase3_shapeit2_mvncall_integrated_v5a.20130502.genotypes.vcf.gz | hadoop fs -D dfs.block.size=134217728 -put - /user/ec2-user/1kg/test_18_11_2015/chr22.vcf
./adam-submit --master yarn-client --driver-memory 8g --num-executors 11 --executor-cores 4 --executor-memory<PHONE_NUMBER>0 -- vcf2adam -parquet_compression_codec SNAPPY -coalesce 10 /user/ec2-user/1kg/test_18_11_2015/chr22.vcf /user/ec2-user/1kg/test_18_11_2015/chr22.adam
15/11/18 05:03:51 INFO Vcf2ADAM: Overall Duration: 34 mins 7 secs
This 34 minutes is almost twice as long as the 18 minutes that the conversion took without the coalesce 10 parameter.
But we don't care much about this time.
The coalesce to 10 parts seems to have worked.
The parquet files are now almost 128 MB each.
105.7	/user/ec2-user/1kg/test_18_11_2015/chr22.adam/part-r-00000.snappy.parquet
119.1	/user/ec2-user/1kg/test_18_11_2015/chr22.adam/part-r-00001.snappy.parquet
93.7	/user/ec2-user/1kg/test_18_11_2015/chr22.adam/part-r-00002.snappy.parquet
100.2	/user/ec2-user/1kg/test_18_11_2015/chr22.adam/part-r-00003.snappy.parquet
104.5	/user/ec2-user/1kg/test_18_11_2015/chr22.adam/part-r-00004.snappy.parquet
106.6	/user/ec2-user/1kg/test_18_11_2015/chr22.adam/part-r-00005.snappy.parquet
105.5	/user/ec2-user/1kg/test_18_11_2015/chr22.adam/part-r-00006.snappy.parquet
70.8	/user/ec2-user/1kg/test_18_11_2015/chr22.adam/part-r-00007.snappy.parquet
58.4	/user/ec2-user/1kg/test_18_11_2015/chr22.adam/part-r-00008.snappy.parquet
117.4	/user/ec2-user/1kg/test_18_11_2015/chr22.adam/part-r-00009.snappy.parquet
Next I started again the adam shell and performed a count.
./adam-shell --master yarn-client --driver-memory 8g --num-executors 11 --executor-cores 4 --executor-memory<PHONE_NUMBER>0
Import the AdamContext and the avro schemas
import org.bdgenomics.adam.rdd.ADAMContext
import org.bdgenomics.formats.avro._
Create the AdamContext
val ac = new ADAMContext(sc)
val genotypes = ac.loadGenotypes("/user/ec2-user/1kg/test_18_11_2015/chr22.adam")
genotypes.count
15/11/18 05:46:12 INFO DAGScheduler: Job 0 finished: count at :30, took 1175.70034 s
So the new count takes 19 minutes, which is more than double the time it took without the coalecse parameter.
This maybe has to do with that the number of parallelism is now limited to 10 chunks, so only 10 cpu (out of the 40) of the cluster are used.

I also tried the projection.
import org.bdgenomics.adam.rdd.ADAMContext
import org.bdgenomics.formats.avro._
import org.bdgenomics.adam.projections.Projection
import org.bdgenomics.adam.projections.GenotypeField._

val ac = new ADAMContext(sc)

val projection = Some(Projection(variant, alleles))

val genotypes = ac.loadGenotypes("/user/ec2-user/1kg/test_18_11_2015/chr22.adam", projection)
genotypes.count

15/11/18 06:11:18 INFO DAGScheduler: Stage 0 (count at <console>:36) finished in 684.361 s

With the projection the count takes 11.5 minutes.
Still slower than the count without the coalesce parameter.
And still slower than decompressing and serializing the variants and genotypes with bcftools view, which takes just 5 minutes on a single cpu.

Using the chr22.vcf from 1kg, count times on 5 16-core nodes are:

Using RDD API ~4.5min
Using Dataset API <10sec

Marking this as closed.


PhantomJS is not capturing images from div having style as overflow hidden.

Hi,
I am using PhantomJS 2.1.1 to capture the screenshot of a webpage.  The page has three divs with style overflow hidden and auto property.  Unfortunately PhantomJS is capturing only top div image and ignoring other div images. Following is the URL for which I am getting issue:
URL : https://item.mercari.com/gl/m56999829099/
Captured images is below:

Please help me out to fix it as soon as possible.
Rakesh.

Please past you code here.Perhaps somebody will help you.

@rkumar-c, what do you mean by overflow elements? For example, the menu that slides horizontally and only a few elements shown at the beginning? In this case, it will not show you all elements of the menu, because it is hidden (you will need to slide to see other elements) and you will receive the same result if you would open this webpage with a normal mobile device.

I need to capture the screenshot of desktop webpage not from mobile devices. I understand that there is scroll  but at least images should be captured whatever is visible. If you will look at image, in second and third frame no images are captured.  I achieved this by writing custom js inside page.evaluate and here is the code:
page.evaluate(function() {

var box=document.getElementsByClassName("items-box-photo");
for(i=0; i<box.length; i++)
{
//	var myimg = box[i].getElementsByTagName('img')[0];
var someimage = box[i].children[0].getAttribute('data-src');
console.log("image src " + someimage);
box[i].innerHTML= " ";
}
});
But this is page specific and we can not run it capture any webpages. Now I am facing issue to capture screenshot of webpages with ajax and lazy loading like amazon.in or http://www.shopclues.com/fashion.html
So is there way to write common code and to capture screenshot of webpage like amazon or any other with lazy load webpages?

I'm a CasperJS/PhantomJS user for couple of years. Hmm normally images don't show up because they haven't completed loading. Not sure if explicitly waiting before capturing the images will help.

@rkumar-c, make sure check that you don't have
page.settings.loadImages = false

Once I have activated this setting in the script and could not understand why images were not loading for me.

虽然我英文不好，大概的意识好像是捕获图片的时候，只捕获到左面的部分，不是完整的宽度。如果是，你试试
var bb = page.evaluate(function () {
return document.body
});
// 按照实际页面的高度，设定渲染的宽高
page.clipRect = {
top: 0,
left: 0,
width: bb.clientWidth,
height: bb.clientHeight
};

突然想到我也遇到这样的问题。我在html文件里面只输入了几个文字，结果render出来的图片大小是400*300的。好像是phantomjs的最小长宽。 @bologer 是不是phantomjs确实做了默认的设置？

I am not getting the full page screenshot for following two URLs:
https://shop.adidas.co.in/#c/men-basketball-shoes/Pag-60/No-0/0
http://www.lifestylestores.com/c/men-tops-tshirts
Can anybody provide sample code to capture screenshot for above URLs.

I'm not expert at PhantomJS, but for a general purpose web automation tool that I make (base on CasperJS/PhantomJS), the code is below. I get Adidas logo only for second row of images onwards. For the second website, it is blank image for below and also when I use Safari browser. Not sure what is wrong with the website that I cannot even also with real browser.
https://shop.adidas.co.in/#c/men-basketball-shoes/Pag-60/No-0/0
wait 10 seconds
snap page to adidas.png
http://www.lifestylestores.com/c/men-tops-tshirts
wait 10 seconds
snap page to lifestore.png

@rkumar-c your problem with the first website is the loading time. For some reason it takes around 20 seconds to load all images and everything on the website.
This is what I received on 15 secs, so I assume that you will have all images loaded on 20secs.
Screenshot

Source code
var p = p || {};

p.adidas = {

	webpage:	false,
	system:		false,
	page:		false,
	url:		false,
	userAgent:	false,
	newsJSON: 	false,
	newsString: false,

	init: function() {
		this.webpage	= require('webpage');
		this.fs 		= require('fs');
		this.page		= this.webpage.create();
		this.url		= 'https://shop.adidas.co.in/#c/men-basketball-shoes/Pag-60/No-0/0';
		this.userAgent	= 'Mozilla/5.0 (Windows NT 6.3; rv:36.0) Gecko/20100101 Firefox/36.0';
		this.timeout	= 20000;
		this.log		= '[ =========> ] ';
	},

	solve: function() {
		var self = this;
		this.page.settings.userAgent = this.userAgent;
		this.page.viewportSize = { width: 1024, height: 900 };

		this.page.open(this.url, function(status) {

			console.log(self.log + 'Page loaded');

			try {
				setTimeout(function() {

					console.log(self.log + 'Timeout finished.');

					self.page.render('1.png');

					console.log(self.log + 'Picture taken');

					console.log(self.log + 'Job should be finished now');
					phantom.exit()
				}, self.timeout);
			} catch(e) {
				console.log('PhantomJS has unexpectable stopped working. Date: ' + new Date().toUTCString());
				phantom.exit();
			}
		});
	}
}

p.adidas.init();
p.adidas.solve();

@bologer  I tried the above code but fails to capture all the images, this is also happening with ebay and alibaba websites. What could be the reason for not capturing all the images, I increased the timeout 90000 but that also didn't work.

@rkumar-c, alright, I will test my code a bit more and will try to output working solution :+1:

Also adding on, invisible browsers such as PhantomJS or Electron (through NightmareJS) are different in behaviour from real browsers such as Chrome or Safari. And website owners often add logic to prevent invisible / automated browsers from working correctly.
This is a nice post by a friend on this topic. Although I normally will not automate for websites which don't want to serve automated browsers. https://franciskim.co/dont-need-no-stinking-api-web-scraping-2016-beyond
Other possible setups could be using Selenium + Chrome + Xvfb or maybe SikuliX + Xvfb to replicate exact browsers behavior. Also, headless Chrome is here (Firefox headless soon too). Tools such as CasperJS which have intention to support headless Chrome or Chromy can also be considered.

@rkumar-c, if purpose of this threat to get images of the product from let's say Adidas, then the following code can be used. It is not required to load the images unless the whole DOM has loaded, than you can scrap the URL of the images and recursively saved them as you wish.
I have written everything until recursive saving, this all on you.
var p = p || {};

p.adidas = {

	webpage:	false,
	system:		false,
	page:		false,
	url:		false,
	userAgent:	false,
	newsJSON: 	false,
	newsString: false,

	init: function() {
		this.webpage	= require('webpage');
		this.fs 		= require('fs');
		this.page		= this.webpage.create();
		this.url		= 'https://shop.adidas.co.in/#c/men-basketball-shoes/Pag-60/No-0/0';
		this.userAgent	= 'Mozilla/5.0 (Windows NT 6.3; rv:36.0) Gecko/20100101 Firefox/36.0';
		this.timeout	= 6000;
		this.log		= '[ =========> ] ';
	},

	solve: function() {
		var self = this;
		this.page.settings.userAgent = this.userAgent;
		this.page.viewportSize = { width: 1024, height: 900 };

		this.page.open(this.url, function(status) {

			console.log(self.log + 'Page loaded');

			try {
				setTimeout(function() {

					console.log(self.log + 'Timeout finished.');

					var imageUrls = self.page.evaluate(function() {
						var q = document.querySelectorAll('.productListing li.card');
						var obj = {};
						var length = q.length - 1;

						for(var i = 0; i <= length; i++) {
							obj[i] = {
								name: q[i].querySelector('.adidasOriginals.productIdentifier').innerText.trim(),
								src: q[i].querySelector('.productImageWrap > img').getAttribute('data-src').trim().replace(/\.plp$/gi, '')
							};
						}

						return obj;
					});

					self.page.render('1.png');

					console.log(self.log + 'Picture taken');

					console.log(self.log + 'Job should be finished now');

					console.log(self.log + 'Images:');

					console.log(JSON.stringify(imageUrls));

					self.fs.write('urls.txt', JSON.stringify(imageUrls));

					phantom.exit()
				}, self.timeout);
			} catch(e) {
				console.log('PhantomJS has unexpectable stopped working. Date: ' + new Date().toUTCString());
				phantom.exit();
			}
		});
	}
}

p.adidas.init();
p.adidas.solve();

Though I am not sure if this is what you are looking for.

I am still trying to understand why it is not allowing to load all images form the website even if you put huge timeout on the load of the page (e.g. 30 secs).

I will try again and give you the results :+1:

Cool stuff! Thanks @bologer for sharing! :smile:

Thanks guys for promptly replying to the issue with solutions, I really appreciate solution given by @bologer and it was very much helpful to me.
Here I am closing this thread and once again thanks to @bologer.


4 second delay before printing

Hello, we have a problem with cups, when we want to print there is a delay of 4 seconds before printing, this delay does not exist under windows.
We used a rapsberry pi (rapsbian 9.4), the version of cups is 2.2.1 and we use the drivers for a zebra printer "Zebra EPL2 Label Printer"
I would thank you if you could try to help us with this problem,
Can you tell me what additional information I should provide you so that you can help me?
Regards
cups_ppd.txt

Dupe of issue #5256.


Update electerm.json 1.26.1

update electerm to 1.26.1

https://github.com/ScoopInstaller/Extras/commit/b95a14d844f4b773ba2cc304c63942cdff0cbf9b


Overflow group causing warnings when running tests in other d2l repositories

When running unit tests in other repos occasionally the tests would fail with the error:
Error: ResizeObserver loop limit exceeded (http://localhost:9876/context.html?v=home%2C0&cvhf=0%2C1&caf=&undefined=&cgf=20%2C40&daf=7&tcgf=bottomRight#:0)
The error essentially means that the ResizeObserver was not able to deliver all of its observations within the same animation frame. This is a non-fatal error but would cause the tests to fail, I did a bit of investigating and it seems like replacing throttle with requestAnimationFrame is suitable in this scenario. They should have a very similar effect in this case since rAF targets 60fps which is about 16ms (very similar to the throttle value).
There is another option of ignoring the errors within the tests but I thought it would be bothersome to have to do that for every repo we started seeing this in.

So we do have a tool to suppress this error which got added here https://github.com/BrightspaceUI/core/pull/1101/files and is in the BrightspaceUI initializer, so it would get used in new repos. If this strategy works though and seems safe then that sounds alright to me.

Yeah I was thinking it would probably get caught in whatever production js error logging we had and could get annoying. Didn't realize it was already a thing happening! It seems like the consensus is that this should prevent the error from firing in the first place, but it's been difficult to reproduce it with npm link locally

Was it a specific browser that was failing for this?  Legacy Edge doesn't support ResizeObserver so it would be relying on the ponyfill, which hacks together some things to provide an RO API.


This is described in #1554 and is only broken in master so no need to merge into 2.1.x maintenance etc.
Fixes #1554.

Still need to fix test-bi-reflect-construct-tail.js, I'll do that later today.


merge package template from Kronos-Tools/npm-package-template

Updated standard to latest version

Codecov Report

Merging #83 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #83   +/-   ##
=======================================
  Coverage   89.47%   89.47%
=======================================
  Files           1        1
  Lines          19       19
=======================================
  Hits           17       17
  Misses          2        2

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0d01d9a...6c1f34a. Read the comment docs.


Add control for energy export setting

Add control for energy export setting ("Solar" or "Everything"). Note, may only apply to Time-Based Control?

Added in Powerwall Manager V0.3.81


Exercize 1 not working

Hi,
i am trying to start exercize number 1, but when i run it returns me this error:
File "C:\Users\RoY\Desktop\VRscience\bci_workshop-master\mules.py", line 93, in sendcommand
self.client.send(command)
TypeError: a bytes-like object is required, not 'str'
I am not a coder, i have just started learning.
edit: I fixed it by adding a b in the line:     self.client.send(b'command')
Now i get this message:
Attempting connection
Connection successful
Header request
But no windows showing signal pop up
Thanks in advance for the help.
Cheers,
V.

Hi, which version of Python are you using? It should be Python 2.x

Hi, thanks for replying! I have installed Anaconda (Win 64bit) as suggested.I had python 3.6(32bit) already installed, could this matter?

Exactly, that is the issue, the socket module is different from Python2 to Python3. I just pushed a newer version that is compatible with Python2 and 3. Try that one.

Thanks a lot! It worked out! Could you explain me how you did it? Is it something a newbie like me could easily understand? I would like to learn how to fix this issue so i can also do it by myself.
Thanks again!

The changes were made in the file mules.py. There are two main changes: (1) the syntax in the print function, and the input type for the functions from the module socket. You can see the changes in detail in the respective commit


postposing in nominal structure?

Or is the by-PP an indirect complement analogous to the adjective-licensed ones on p. 1249?

I'm going with indirect complement, but I don't have any good arguments to support or undermine either position

Another possible indirect complement:

This is especially tricky because the indirect complement has escaped the coordinated NPs. I could imagine the two NPs having gaps, but that would leave a Postnucleus under a PP, which seems odd.


Example.py Error?????

Traceback (most recent call last):
File "C:/Users/Craig/PycharmProjects/untitled2/s.py", line 7, in
"chatterbot_voice.Voice"
File "C:\Python27\lib\site-packages\chatterbot\chatterbot.py", line 36, in init
self.add_adapter(adapter, **kwargs)
File "C:\Python27\lib\site-packages\chatterbot\adapters\adaptation.py", line 33, in add_adapter
adapter = NewAdapter(**kwargs)
File "C:\Python27\lib\site-packages\chatterbot_voice\voice.py", line 15, in init
subprocess.call(['jack_control', 'start'])
File "C:\Python27\lib\subprocess.py", line 522, in call
return Popen(*popenargs, **kwargs).wait()
File "C:\Python27\lib\subprocess.py", line 710, in init
errread, errwrite)
File "C:\Python27\lib\subprocess.py", line 958, in _execute_child
startupinfo)
WindowsError: [Error 2] The system cannot find the file specified

This is the error I received after running your example program on  windows (python 2.7.10) after installing chatterbot-voice through pip.

This error is happening because the program is attempting to start jack_control (subprocess.call(['jack_control', 'start'])) which is not a valid command in windows. I will make changes to ensure that this works properly.

Hi @Cyber-Shadow This should be fixed in version 0.0.2 of chatterbot-voice. Feel free to reopen this ticket if the issue persists.

Traceback (most recent call last):
File "C:\Python27\chatbot.py", line 14, in
database="../data.db"
File "C:\Python27\lib\site-packages\chatterbot\chatterbot.py", line 51, in init
self.storage = StorageAdapterClass(**kwargs)
File "C:\Python27\lib\site-packages\chatterbot\adapters\storage\jsondatabase.py", line 16, in init
self.database = Database(database_path)
File "C:\Python27\lib\site-packages\jsondb\db.py", line 13, in init
self.set_path(file_path)
File "C:\Python27\lib\site-packages\jsondb\db.py", line 21, in set_path
write_data(file_path, {})
File "C:\Python27\lib\site-packages\jsondb\file_writer.py", line 21, in write_data
with open(path, "w+") as db:
IOError: [Errno 13] Permission denied: '../data.db'
WHAT IT MEANS???

Hi @hiradadiamond, I think you have a permission error on your database file. Check out the last line in the traceback you posted:

IOError: [Errno 13] Permission denied: '../data.db'

You don't appear to have permission to access the file location where data.db is being created. Try creating it in a different directory or add permission for your user to access the directory it is being created in.


Bulk download limits?

Hi,
This is a really great package! I was wondering what the best way to download the results for all human genes is?
Ideally I would just loop over the individual gene script query for all human genes and store them into my own simple two table database but I wanted to ask first!
cutoffScore <- 0.2
diseasesEvidenceForGeneAsDataFrame <- geneObj$getEvidenceDiseasesForGeneAsDataFrame(ensemblGeneID, cutoffScore)
diseaseAssocsForGene <- geneObj$getAssociationDiseasesForGeneAsDataFrame(ensemblGeneID, cutoffScore)
Thanks
Iain

Hi Iain,
Glad to hear you find our platform great!
You can download the association objects from https://www.targetvalidation.org/downloads/data.
You may want to use a elasticsearch database like we do. We've just moved to elasticsearch v2.3 as highlighted at the end of your release blog post (https://blog.opentargets.org/whats-new-in-release-1-2/).
Hope this helps.
Cheers,
Denise
p.s. We have a public mailing list<EMAIL_ADDRESS>for release announcements and web status updates. It's a low traffic list for users who want to keep up-to-date on Open Targets developments. Can we sign you up to this list?

Hi Denise,
Please sign me up!
I will certainly look into downloading the data, but the reason I asked about the download limits is because this package nicely cleans up the json object into the exact format that I am looking for.
thanks
Iain

Thank you Iain! I just need your email address now. Email us on<EMAIL_ADDRESS>if you can, so that we can have it.
It may be useful to know that if you want to clean up the json, you can use the fields parameter in the API, and choose a threshold of 0.2 for the score as well.
Kind regards,
Denise
twitter.com/targetvalidate
<EMAIL_ADDRESS>


.pdb is missing in nuget

<IP_ADDRESS> and .11 is the pdb not in the nuget!

Yes. I when I uploaded the file to nuget I had some doubts if I uploaded the correct version.
Do you really need it ?

For debugging it would be nice... Do you not use a CI system like Appveyor to upload to nuget?

Appveyor can now also patch the new csproj files during build

du you upload the ".symbol.nupkg" when you push the nuget? because it contains the pdb and the source!

I will upload a new NuGet with debug symbols in some time. I will write here when I've done it.

i think with csproj you should upload both nugets, the one without pdb, and one with source and pdb