Page.select does not work for some elements

I'm trying to select "select option" value in https://www.gumtree.com/ But it doesn't change the select element's value

This is the html source for this component:
<select name="attributes[vehicle_make]" id="vehicle_make" data-validation-group-channel="cars-vans-motorbikes-details-group" required="" aria-required="true" aria-invalid="false">     <option value="">Please select...</option>       <option value="abarth">Abarth</option>       <option value="ac">AC</option>... </select>
This is the code i'm using:
const select_vehicle_type = await page.waitForSelector("#vehicle_make");
var value = 'Audi'; // I tried both 'Audi' and 'audi' as value but both doesn't work
await page.select('#vehicle_make', value);

Can someone please point out what is the issue here?

Found the issue. Issue is I was trying to set the value to dropdown before the page setting initial value to the dropdown fetched from the server. I added timeout to wait and then used await page.select('#vehicle_make', value); and it worked as expected.


Replace loading indicators

We want to make some updates to the way we load items:

Show no loading indicator if the request returns within 1 second
After 1 second, show a shimmer/skeleton state

TODO: Document all the places where we currently use loading spinners.

Bug bankruptcy.

Bug bankruptcy.


IMGUR : Unable to download webpage

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like that [x])
Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.01.28. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2017.01.28

Before submitting an issue make sure you have:

[x] At least skimmed through README and most notably FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add -v flag to your command line you run youtube-dl with, copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
C:\Transmogrifier>youtube-dl.py -v "http://imgur.com/vCVKZdA"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'http://imgur.com/vCVKZdA']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2017.01.28
[debug] Python version 3.5.1 - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-71727-g46778ab, ffprobe 3.2, rtmpdump 2.4
[debug] Proxy map: {}
[Imgur] vCVKZdA: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 403: Forbidden (caused by <HTTPError 403: 'Forbidden'>); please report this issue on https://yt-dl.org/bug . Make sure you
ype  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "C:\Transmogrifier\youtube-dl.py\youtube_dl\extractor\common.py", line 406, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "C:\Transmogrifier\youtube-dl.py\youtube_dl\YoutubeDL.py", line 2001, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "C:\Program Files\Python35\lib\urllib\request.py", line 471, in open
    response = meth(req, response)
  File "C:\Program Files\Python35\lib\urllib\request.py", line 581, in http_response
    'http', request, response, code, msg, hdrs)
  File "C:\Program Files\Python35\lib\urllib\request.py", line 509, in error
    return self._call_chain(*args)
  File "C:\Program Files\Python35\lib\urllib\request.py", line 443, in _call_chain
    result = func(*args)
  File "C:\Program Files\Python35\lib\urllib\request.py", line 589, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Single video: http://imgur.com/vCVKZdA
Same video: http://i.imgur.com/vCVKZdA.gifv

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.

Thanks as always...
Ringo

Can you watch it in browser in the first place?

Maybe there was an temporary issue on imgur.com
$ youtube-dl -v "http://imgur.com/vCVKZdA"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'http://imgur.com/vCVKZdA']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.02.10
[debug] Git HEAD: e01bfc19c
[debug] Python version 3.6.0 - Linux-4.9.6-1-ARCH-x86_64-with-arch
[debug] exe versions: ffmpeg 3.2.2, ffprobe 3.2.2
[debug] Proxy map: {}
[Imgur] vCVKZdA: Downloading webpage
[debug] Invoking downloader on 'https://i.imgur.com/vCVKZdA.mp4'
[download] Destination: One guy beating the commute yesterday - thoughts on lane splitting-vCVKZdA.mp4
[download] 100% of 1.00MiB in 00:03


v3

This improves the FullsizePicture component API and adds an examples page for Codesandbox.
Breaking changes:

Removes css prop from Picture and pictureCSS prop from FullsizePicture component. Styling is now done exclusively through className prop.
className prop in FullsizePicture is assigned to the inner Picture component to keep API consistency between components. It was previously called pictureClassName.
New wrapperClassName prop to style wrapper component in FullsizePicture. It was previously called className
FullsizePicture default behaviour now mimics background-size: cover behaviour for full-width images

Other changes:

Update to README and CONTRIBUTING docs
Adds examples to be used in Codesandbox
Removes glamorous and adds cxs for styling

This version also makes this library substantially smaller, bringing the size down from 26.4 kB to 7.72 kB (70% reduction).

duplicated


Doesn't  handle special chars in productnames etc

Tested the DX version for OC2 and noticed it doesn't handle special chars in product names, and probably in other fields - the HMAC calculation will fail.
T.ex isn't this product name accepted: Apple Cinema 20" Display

because of the double quote.

Old bug in a new module. ;)

Thank you, now it is fixed


highlightSearchTermsOnTargetPage not working, and more issues

Hey there. I've been trying out this library, and I can see that multiple things are not working: -

[ ] highlightSearchTermsOnTargetPage not working: When I set this to true, search items in the search page are being marked, but I do not see that happening anywhere else. This is a duplicate of #71

plugins: [
    [
      require.resolve("docusaurus-plugin-search-local"),
      {
        // `hashed` is recommended as long-term-cache of index file is possible.
        hashed: true,
        highlightSearchTermsOnTargetPage: true, // this should highlight the search text everywhere
      },
    ],
  ],

[ ] I tried contributing by making a fork of the repo and there seem to be some initial problems. For installing the node_modules for the Plugin, I had to install the modules using --legacy-peer-deps and the same had to be done for the website as well. However, the bigger problem was that I was unable to run and build the website.

Did I miss any step, or am I doing something wrong?

@rishabmahesh
Hi, What version did you use?
The latest<EMAIL_ADDRESS>is working!
And I think highlightSearchTermsOnTargetPage function is only working in 'See All Results' page. '~/search'

Hey @HelloHailie. I might have misunderstood how search would have been working in that case. Unfortunately I don't have access to that code anymore, so I wouldn't be able to contribute this issue further


Luna1 https://lcd.terra.dev/cosmos/tx/v1beta1/txs returns 403

Luna1 report is not working.
https://lcd.terra.dev/cosmos/tx/v1beta1/txs returns 403, permission denied.

Thanks for the info.  I'll need to update documentation somewhere but looks like lcd.terra.dev became restricted sometime around the birth of Terra 2.0.  You can find alternative LCD endpoints here https://github.com/cosmos/chain-registry/blob/master/terra/chain.json .
Example:
export STAKETAX_TERRA_LCD_NODE=https://...

Updated code not to use lcd.terra.dev as default: https://github.com/hodgerpodger/staketaxcsv/commit/e35cae782467b28836b2fa85e88686a73fd80ad3


white list

do the bot catches from the whitelist chat only if any?

only if any?

Can you elaborate? Didn't quite understand this.
The bot's catching and other utility functions works only in whitelisted channels if you're operating in that mode.


Microsoft.VisualStudio.2022.Professional-Preview version 17.5.0

[ ] Have you signed the Contributor License Agreement?
[ ] Have you checked that there aren't other open pull requests for the same manifest update/change?
[ ] Have you validated your manifest locally with winget validate --manifest <path>?
[ ] Have you tested your manifest locally with winget install --manifest <path>?
[ ] Does your manifest conform to the 1.4 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

@denelon Please kick off new run.

/azp run


support for Swift3 with Xcode-beta6

This updates the syntax for Swift3, with Xcode-beta6 language updates.
The target Use Legacy Swift Language Version build setting is set to NO.
Validated in internal development for ~2 weeks.

@sstadelman have you seen any issues like:

@esetnik no, I haven't seen that... is your framework search path set correctly?

@sstadelman are you using Cocoapods or carthage to manage your NibDesignable dependency?

@mbogh can you rerun the travis tests? They failed with a strange error and the tests pass locally.

Using xcodebuild build-for-testing test-without-building should stabilize the CI builds on Travis with Xcode 8.

@mbogh can we get this merged?

If we could get Travis happy again, I am all for this PR :)

@mbogh the tests are actually passing it's just that travis was flakey when @sstadelman uploaded his build. You can see a recent passed test run using the same commit at https://travis-ci.org/esetnik/NibDesignable/jobs/160884386. Please rerun the tests on travis and they should pass this time.

See my comment above for the test failure: https://github.com/mbogh/NibDesignable/pull/42#issuecomment-246109828

Travis build has been restart lets see what the verdict is :)

@farzadshbfn do you have any objections?

@mbogh no, I had objections against other PR's. this one's so clean 👍


Icon download can only generate 2 maximum icons in a .ttf file

Tried to download more than two customized icon here
https://www.fluttericon.com/
However, the generation of .ttf files only allow two maximum regardless how many icons I selected.
.dart and .json is working fine

@Laikaiyong send me a svg example file, I need generate x.com, kwai.com and threads.net


Poor test results from one checkpoint

Hi, Weijing,
I used the checkpoint car_auto_T3_trainval to do initial test on KITTI test dataset with the following command:  python3 run.py checkpoints/car_auto_T3_trainval/ --test --dataset_root_dir DATASET_ROOT_DIR --output_dir DIR_TO_SAVE_RESULTS.  However, the results I got are too bad because only a few cars can be detected. Also, it is strange that all the detected bounding boxes are only located on the right side of the frames, shown as figures below.  Do I need to change any parameters？ Could you please give me some advice? Thanks.

Hi @zjx99 ,
The KITTI detection benchmark only provides annotations that are visible in the image plane. The training data and labels will probably give your similar visualization results. Point-GNN is trained to detect objects within the same area. In fact, we remove points outside the image during preprocessing. To handle all the objects with 360 degrees, ideally, we would want to get all the annotations and retrain the network. But a quick hack you can pull is to rotate the point cloud to multiple degrees and combine the detection results. Hope it helps.

Thank you very much! It is a smart idea to rotate the point cloud in order to get all the detections.  I will try it and hope better results will come out.

Hi, Weijing,
I am trying to do the test on my own lidar data. But the problem is that I don't have images in accordance with lidar, so the obtained txt files are all empty when using the default KITTI images since they don't match with my lidar data. I tried to remove the restriction of the images in kitti_dataset.py, but got many errors in the end.  Any advice on this issue? Thanks.

Hi @zjx99,
I am not sure about your sensor configuration. In general, if you want to use the checkpoint pretrained on KITTI, you need to do a few conversions. First, convert your point cloud to the KITTI camera coordinates. You only need to align the axis through rotation, Point-GNN is invariant to global translation. Save the converted points.
In the run.py, replace dataset.get_cam_points_in_image_with_rgb() with a method to load your point cloud. something like get_velo_points(). Also, you might want to crop your point cloud to the camera front area to save some GPU memory.
https://github.com/WeijingShi/Point-GNN/blob/48f3d79d5b101d3a4b8439ba74c92fcad4f7cab0/dataset/kitti_dataset.py#L587
The visualization won't work as it uses RGB. But the script should be able to process your point cloud.

Thanks a lot for the solution.
However, my target is to detect all the vehicles using the pre-trained model and show the boxes just in the point cloud, which makes images not useful to me at all. Since the images are only used for visualization in the whole process of your work, could I just directly remove them
and do the test on the original point cloud?  Is there any particular reason that I have to convert my point cloud to the KITTI camera coordinate system?

Hi @zjx99,
The reason we need to convert your point cloud to the KITTI camera coordinates is that the checkpoint is trained in KITTI camera coordinates. e.g., in KITTI the y-plane is the ground plane, etc. If your point cloud has z-plane as the groud, the checkpoint won't understand that. It's a pre-processing step to match the custom dataset with the training data. You can then convert the detection results back to your coordinate system.

Hi, Weijing,
I've converted my point cloud to the coordinate system of KITTI test data by registration( shown in the first figure, red is mine), and then load it through get_velo_points function, which has been revised as shown in the second figure to accept csv file. However, the problem is that the txt file after detection are still empty.  I didn't transfer my lidar to KITTI camera coordinates directly as you suggested because I think as long as my lidar has been aligned with the KITTI lidar data, the imported points will be transferred later by the get_cam_points function.  Is there any problem?

Moreover, I don't really understand the difference of the following two functions, could you please give more explanation?

Thank you very much

Hi @zjx99,
Can you help to explain your "registration" process? After "registration", does the point cloud have the coordinate axis like the followed?

In the run.py, do you use get_cam_points() instead of get_cam_points_in_image()?.
You can use the visualization without rgb by removing the following line. This might help for debugging.
https://github.com/WeijingShi/Point-GNN/blob/48f3d79d5b101d3a4b8439ba74c92fcad4f7cab0/run.py#L161
velo_points_to_cam() and velo_to_cam() is doing the same thing with different input type. points are a namedtuple, points_xyz are [N, 3] np.array.

Hi, Weijing,
I used ICP to do the registration, in which the reference is the KITTI point cloud(R), and the template is my point cloud(T). After registration , ideally, T has been converted to the coordinate system of R, which means the axes are parallel and the origins are almost the same( without considering the translation currently).  And also, I used get_cam_points() in run.py.  Unfortunately, there were still no results coming out.

Hi @zjx99,
From the image, it seems you ran ICP between the KITTI and your custom dataset. Since they are not from the same scene, the registration quality is poor. Is it ok to manually check if they have a similar coordinate system after R?  Particularly, do they have the same y-axis (height)?

Hi, Weijing,
I manually checked in Cloudcompare, they seem to be in similar system especially in terms of height. Also, to clarify, currently z-axis is the height because I was trying to convert my point cloud to the KITTI velo system in the first place, then it can be converted to the KITTI camera system by the calib file. It is the right procedure, isn't it?
Also, now I have difficulty determining the coordinate system of my point cloud. I can't decide the directions of x-axis and y-axis, so actually I don't quite know how to convert it to KITTI system without considering registration.  Any advice from you about deciding the system of my point cloud?  Thanks.

Hi @zjx99, sorry for the late reply. Yes, you are right, the z-axis should be the height in the lidar frame. We can try to decide the axis by manually find some vertical objects such as a wall or lamp pole and set the z-axis.  However, it's unclear how sensitive is the network to the calibration error. If you have annotations in your dataset, maybe you can retrain or finetune the checkpoints. Thanks.

@zjx99 您好！想问一下，换成自己采集的激光雷达数据集您这边现在能够检测吗？

@zjx99 您好！想问一下，换成自己采集的激光雷达数据集您这边现在能够检测吗？

@GXQ0527 ,
Hi,
No, I didn't get good results,  so I changed to other methods.

@GXQ0527 ,
Hi,
No, I didn't get good results,  so I changed to other methods.


fix(ProfilePage): should see other users' profile page

explaination
I found that latestSlug returns null when the user hasn't set their slug yet. Therefore, I changed latestSlug === undefined to !latestSlug && latestSlug !== ''
Additionally, if the user resets their slug to an empty string, it will fail the condition. To address this, I changed the userId to ensure redirection leads to the user's page instead of "my" page.
preview

able to see other user's profile page

coverage: 71.733%. remained the same
when pulling 1cf6711fe258829b000325ad4775c06d7c2e8375 on belong112:bugfix/issue#587
into d5a4be4117b37ccd37dbdf4f7c48e30547ccae24 on cofacts:master.


Add support for executing changes on hasMany relations

I commented earlier in one of the issue threads on ember-changeset-validations. This fix should solve the issue I was having. Thanks for your consideration.

Found this addon and it's excellent! 💯  We're using something home-baked that is fairly similar (but this one is better).
Also curious about relationship changes. What's the status here? @poteto @gmarkv10

Friendly ping @Dhaulagiri and @snewcomer 😄

@snewcomer Certainly! 👍

I verified that adding and removing has many relationships on master works.  Lmk if anybody has any other issues!


fix: add regions for google cloud provider

Adds regions for Google Cloud to cloudProviderRegions.

LGTM but there are some lint issues to fix before merging

@renanvice lint updated pushed as apart of https://github.com/elastic/harp/pull/268/commits/93e253efedf9988e1300d32d7051c2e5197e6f54


add has_*_preview for all type of preview

Currently only "pdf" has a "has_" method (has_pdf_preview). To have a better usability of preview_generator, we should know for all content if text, json, html, pdf, and jpeg preview should be available.

@inkhey fixing this issue in a generic manner will probably be the subject of an engineer training for february 2019. For now, we must fix it for jpeg, so there are 2 issues: one to fix fast about has_jpeg_preview(), the other for fixing on a generic way

@inkhey, the issue seems to be fixed (fix is merged), you confirm? If so, could you close the issue?

yes.


CanDestroy Item Flag

Enhance adventure mode mechanics by allowing items with the CanDestroy flag to be created through denizen (easily).
Encourages adventure playwork

:heavy_plus_sign::+1: Please add CanPlaceOn too.

@brainscript please open a separate issue for that. We're trying to keep each bit separate here, as they are technically separate, despite being similar in how they work.

@mcmonkey4eva That's the opposite of CanDestroy. I don't see a reason to create a seperate issue for that. I would rename the issue to "Adventure Mode Item Flags".

@brainscript They would have to be implemented entirely separately, therefore they should be separate issues. That way we can do one commit that closes CanDestroy, and another issue that closes CanPlaceOn.

Added in latest dev builds thanks to


fix(Query): Accept any CharSequence

Don't require to wrap a CharSequence with a String to setQuery.

In this case Places Query should be changed too ? https://github.com/algolia/algoliasearch-client-android/blob/master/algoliasearch/src/main/java/com/algolia/search/saas/places/PlacesQuery.java


958: Implementing simple idempotency mechanism for payment submission

Fixing bug in PaymentSubmissionRepository which meant that certain payments do not find any existing records because they query the wrong field

Created Extension repository definitions and implementations for each payment type which use MongoTemplate directly to do the querying

See https://medium.com/@dangeabunea/how-to-create-a-custom-mongodb-spring-data-repository-e51c343064e1

Creating IdempotentPaymentService which is used to find any existing payments with matching idempotency data

Removed IdempotentRepositoryAdapter
Created 2 implementations of IdempotentPaymentService

One impl for all IntentTypes with a 0..1 relationship between consent and payment (everything except VRP)
VRP impl which handles 0..* relationship

Idempotency checks are shifted earlier in the controller impl in order to avoid validation failures

This change is necessary as the validation framework checks if a consent is Authorised and will therefore fail if the consent is Consumed due to a payment already existing
The previous impl worked because of a bug in the policy script allowing payment POST requests through to the RS when the consent had Consumed status.

Adding unit test coverage for idempotent behaviour

As noted in the code, this approach to idempotency is simplified. It is not guaranteed to work when there are concurrent requests, as we have a non-atomic check then create pattern. To implement idempotency properly, we would need a dedicated datastore and use transactions. This is deemed overkill for a test facility as we do not actually make any payments.
The simplified approach is good enough for TPP developers to test the API contract (serially) to see the idempotent behaviour and test the error cases e.g. using the same idempotency key but changing the payload
An interesting article on how to implement idempotency: https://www.lpalmieri.com/posts/idempotency/#4-2-idempotency-keys
https://github.com/SecureApiGateway/SecureApiGateway/issues/958

This PR is a work in progress.
@BohoCode @jorgesanchezperez please can you review the approach and let me know any feedback.
I've migrated Domestic Payments and VRP to use the new idempotency service. All other controllers need to be updated, and test coverage adding.


TaskOOM event lost

Description
https://github.com/kubernetes/kubernetes/issues/119600
When I was troubleshooting the problem that the Reason was not OOMKilled, I found that the container lost the TaskOOM event.
Steps to reproduce the issue
e2e: https://prow.k8s.io/view/gs/kubernetes-jenkins/logs/ci-containerd-node-e2e-1-7/1683184526936772608
logfile:  https://storage.googleapis.com/kubernetes-jenkins/logs/ci-containerd-node-e2e-1-7/1683184526936772608/artifacts/tmp-node-e2e-92a26bb7-cos-97-16919-353-1-system.log
containerd_id: 98bac6c4b73cfd4c647647aa80248208b67de059874d4ddfdd1aa43ea3967e54
containerd_name: oomkill-multi-target-container

kernel having trigger oom

Jul 23 18:56:46 tmp-node-e2e-92a26bb7-cos-97-16919-353-1 kernel: oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=cri-containerd-98bac6c4b73cfd4c647647aa80248208b67de059874d4ddfdd1aa43ea3967e54.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17efb6ec_09ab_4eec_8ad6_f953eb1a7466.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17efb6ec_09ab_4eec_8ad6_f953eb1a7466.slice/cri-containerd-98bac6c4b73cfd4c647647aa80248208b67de059874d4ddfdd1aa43ea3967e54.scope,task=dd,pid=38287,uid=0
Jul 23 18:56:46 tmp-node-e2e-92a26bb7-cos-97-16919-353-1 kernel: Memory cgroup out of memory: Killed process 38287 (dd) total-vm:21724kB, anon-rss:14744kB, file-rss:508kB, shmem-rss:0kB, UID:0 pgtables:68kB oom_score_adj:997
Jul 23 18:56:46 tmp-node-e2e-92a26bb7-cos-97-16919-353-1 kernel: Tasks in /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17efb6ec_09ab_4eec_8ad6_f953eb1a7466.slice/cri-containerd-98bac6c4b73cfd4c647647aa80248208b67de059874d4ddfdd1aa43ea3967e54.scope are going to be killed due to memory.oom.group set

and then containerd exit shim

Jul 23 18:56:46 tmp-node-e2e-92a26bb7-cos-97-16919-353-1 containerd[910]: time="2023-07-23T18:56:46.329304474Z" level=debug msg="received exit event container_id:\"98bac6c4b73cfd4c647647aa80248208b67de059874d4ddfdd1aa43ea3967e54\" id:\"98bac6c4b73cfd4c647647aa80248208b67de059874d4ddfdd1aa43ea3967e54\" pid:38265 exit_status:137 exited_at:{seconds:1690138606 nanos:325950236}"
Jul 23 18:56:46 tmp-node-e2e-92a26bb7-cos-97-16919-353-1 containerd[910]: time="2023-07-23T18:56:46.389869167Z" level=info msg="shim disconnected" id=98bac6c4b73cfd4c647647aa80248208b67de059874d4ddfdd1aa43ea3967e54 namespace=k8s.io
Jul 23 18:56:46 tmp-node-e2e-92a26bb7-cos-97-16919-353-1 containerd[910]: time="2023-07-23T18:56:46.390142692Z" level=warning msg="cleaning up after shim disconnected" id=98bac6c4b73cfd4c647647aa80248208b67de059874d4ddfdd1aa43ea3967e54 namespace=k8s.io

After that, no TaskOOM event was received until container delete.

Describe the results you received and expected
Expect to receive TaskOOM event.
What version of containerd are you using?
1.7
Any other relevant information
ubuntu
Show configuration if it is related to CRI plugin.
no

@Iceber is the issue you mentioned before? Let's say that init command is sh -c "oom-process". The "oom-process" causes the oom event but the sh -c doesn't. So, the containerd only records the sh -c exit code instead of sub-process's.

Discuss with @Iceber and think that the shim process exits too quickly, causing the shim not to receive the OOM event.
My idea is that the current watch oom s.ep.Add is executed after the process starts container.Start, whether we can put it before the start.
https://github.com/containerd/containerd/blob/40f26543bdc27cbe8b058ac082e91c5832bb1c41/runtime/v2/runc/task/service.go#L263-L273

Discuss with @Iceber and think that the shim process exits too quickly, causing the shim not to receive the OOM event.

It is also possible that the cgroup was added to the oom watcher after the container was started, and this was when the process was already oom and the cgroup watcher lost the oom event

Discuss with @Iceber and think that the shim process exits too quickly, causing the shim not to receive the OOM event.

It is also possible that the cgroup was added to the oom watcher after the container was started, and this was when the process was already oom and the cgroup watcher lost the oom event

/assign

Discuss with @Iceber and think that the shim process exits too quickly, causing the shim not to receive the OOM event.

It is also possible that the cgroup was added to the oom watcher after the container was started, and this was when the process was already oom and the cgroup watcher lost the oom event

Can it be the same as this than: https://github.com/containerd/containerd/issues/8180?

Discuss with @Iceber and think that the shim process exits too quickly, causing the shim not to receive the OOM event.

It is also possible that the cgroup was added to the oom watcher after the container was started, and this was when the process was already oom and the cgroup watcher lost the oom event

Can it be the same as this than: #8180?

looks like a problem.

type TaskOOM struct {
	state         protoimpl.MessageState
	sizeCache     protoimpl.SizeCache
	unknownFields protoimpl.UnknownFields

	ContainerID string `protobuf:"bytes,1,opt,name=container_id,json=containerId,proto3" json:"container_id,omitempty"`
}

find  ContainerID value is not ContainerID, is SandboxID.

faild test log: https://storage.googleapis.com/kubernetes-jenkins/logs/ci-containerd-node-e2e-1-7/1697683704735862784/artifacts/tmp-node-e2e-b9a730eb-ubuntu-gke-2204-1-24-v20220623-system.log

recive TaskOOM event, butt container_id value 4bcba7fc4369fee4d7d2e6263b58fce52cfc928c6a31cfac4d43c838708991ce is error, but it is SandboxID.

$ Sep 01 19:12:33 tmp-node-e2e-b9a730eb-ubuntu-gke-2204-1-24-v20220623 containerd[1472]: time="2023-09-01T19:12:33.012922721Z" level=info msg="TaskOOM event container_id:\"4bcba7fc4369fee4d7d2e6263b58fce52cfc928c6a31cfac4d43c838708991ce\""

$ Sep 01 19:12:34 tmp-node-e2e-b9a730eb-ubuntu-gke-2204-1-24-v20220623 containerd[1472]: time="2023-09-01T19:12:34.733787645Z" level=info msg="StopPodSandbox for \"4bcba7fc4369fee4d7d2e6263b58fce52cfc928c6a31cfac4d43c838708991ce\""

success test log: https://storage.googleapis.com/kubernetes-jenkins/logs/ci-containerd-node-e2e-1-7/1696958640436547584/artifacts/tmp-node-e2e-d1698486-cos-97-16919-353-23-system.log

recive TaskOOM event, containerd_id is right.

$ Aug 30 19:08:12 tmp-node-e2e-d1698486-cos-97-16919-353-23 containerd[922]: time="2023-08-30T19:08:12.422392986Z" level=info msg="CreateContainer within sandbox \"5df73d21cde36f876f4692a23354ec6e8858851f8fcd2ad20844e7efb7d4d98c\" for &ContainerMetadata{Name:oomkill-single-target-container,Attempt:0,} returns container id \"7c19542bf60d2091b242cc5997afc8224601e0f3f4758385c3e257b27c214ac3\""

$ Aug 30 19:08:18 tmp-node-e2e-d1698486-cos-97-16919-353-23 containerd[922]: time="2023-08-30T19:08:18.386243530Z" level=info msg="TaskOOM event container_id:\"7c19542bf60d2091b242cc5997afc8224601e0f3f4758385c3e257b27c214ac3\""

xlink with some CRI-O worka around this: https://github.com/kubernetes/kubernetes/pull/120460#issuecomment-1708794531

We have also hit this, I can reproduce relatively easily via:
ctr run --memory-limit $((500 * 1024 * 1024)) --mount type=tmpfs,options=size=1G,dst=/tester docker.io/library/ubuntu:latest foo /bin/sh -c 'cat /dev/urandom > /tester/foo'


formula_auditor: make deprecate license check non-strict in core

Also add some more incompatible licenses. These are all not allowed by Fedora and have are classified as not OSI and FSF approved on SPDX.

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same change?
[x] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.

[x] Have you successfully run brew typecheck with your changes locally?
[ ] Have you successfully run brew tests with your changes locally?

Great work here @cho-m!


bug(python): Reranker pyarrow compatibility update

LanceDB version
No response
What happened?
Getting FutureWarning: promote has been superseded by promote_options='default'.   combined_results = self.merge_results(vector_results, fts_results)
the issue is here , needs to be changed to promote_options='default' - https://github.com/lancedb/lancedb/blob/43f920182aa1de35f0055fbf48414907add493da/python/python/lancedb/rerankers/base.py#L122
Are there known steps to reproduce?
No response

This one is fixed
https://github.com/lancedb/lancedb/blob/main/python/python/lancedb/rerankers/base.py#L49


Implement feature to allow hidden files in local copy

Fixes https://github.com/gruntwork-io/terragrunt/issues/394

Thanks for review! Prior to merge, I want one sanity check from @brikis98 on the terminology of the new feature: does include_in_copy make sense? I got that off your comment for the inverse. I can't come up with anything better, but the one thing that bothers me about it is that it isn't obvious that this configuration only exists for local file terraform sources - it doesn't apply to git sources.

Thanks for review! I'm going to merge this in now, and open a follow up PR with the suggested changes from @rhoboat (to avoid another review cycle).


Base Ledger support cloned from LedgerHQ ledger-app-btc

Pushed my master branch to the veil project repo.

This is the original baseline from https://github.com/LedgerHQ/ledger-app-btc/tree/9ae7c41a2f4a6e1c1bfa4eeedb5f8ba044843cc5 that will be then upgraded to support veil.

Sorry I didn't mean to get it auto-closed, was trying to populate it with a few edits to the commit history.


Feature: upgrade the cluster

tested that Kubernetes:v1.24.0 can upgrade to v1.25.0.

Add a "how to upgrade cluster" docs in examples or user guide.

test:

sealos run : sealos run labring/kubernetes:v1.24.0 labring/calico:v3.22.1 --masters <IP_ADDRESS>

root@lmaster:~# kubectl get nodes
NAME      STATUS   ROLES           AGE   VERSION
lmaster   Ready    control-plane   67s   v1.24.0
node1     Ready    <none>          31s   v1.24.0

upgrade : sealos run labring/kubernetes:v1.25.0

root@lmaster:~# kubectl get nodes
NAME      STATUS   ROLES           AGE     VERSION
lmaster   Ready    control-plane   7m19s   v1.25.0
node1     Ready    <none>          6m43s   v1.25.0

scale with new version : sealos add --masters <IP_ADDRESS> --nodes <IP_ADDRESS>

root@lmaster:~# kubectl get nodes
NAME       STATUS   ROLES           AGE    VERSION
lmaster    Ready    control-plane   10m    v1.25.0
lmaster1   Ready    control-plane   112s   v1.25.0
node1      Ready    <none>          10m    v1.25.0
node2      Ready    <none>          83s    v1.25.0

see details at
upgradeTest.txt


Fix issue with choices on JSONArrayFormField

Also apply sort to channel_width and allowed_channel_list during factories.

Closes #
What's Changed

Screenshots

TODO

[ ] Explanation of Change(s)
[ ] Added change log fragment(s) (for more information see the documentation)
[ ] Attached Screenshots, Payload Example
[ ] Unit, Integration Tests
[ ] Documentation Updates (when adding/changing features)
[ ] Example App Updates (when adding/changing features)
[ ] Outline Remaining Work, Constraints from Design

Test failure looks like bad data assumptions uncovered by the change in factory data - I thought we'd fixed that specific one already though -- maybe need to merge latest next into the feature branch?

Test failure looks like bad data assumptions uncovered by the change in factory data - I thought we'd fixed that specific one already though -- maybe need to merge latest next into the feature branch?

I can try that. I was going to save that for later to reduce the need for me to merge multiple times.


add ability to specify connection pool details for sql connectors

add ability to specify connection pool details for sql connectors. The three properties represent the three configuration settings available on the go sql connection:
maxopenconnections
maxidleconnections
connmaxlifetime
By default the go defaults, are more appropriate for development, specifically the go defaults allow unlimited number of open connections, only 2 idle connections, and a connmaxlifetime of 0 which closes the connection immediately when closed.  For queries which request in a number of calls to the database, this can be costly, especially in the postgres case, which forks a native process for each connection.

This change is

Reviewed 2 of 5 files at r4.
Reviewable status: all files reviewed, 1 unresolved discussion (waiting on @3pCode)

graph/sql/quadstore.go, line 130 at r4 (raw file):

	if err != nil {
		clog.Errorf("Could not retrieve maxopenconnections from options");
		return nil, err

It may be better to wrap an error with fmt.Errorf instead of logging it.

Updated to wrap with fmt.Errorf


Date (skeletons): dynamically augment availableFormats

WIP PR: #604 (replaced #462)

As specification says:

It is not necessary to supply dateFormatItems with skeletons for every field length; in many cases fields in the skeleton and pattern can be expanded in parallel to handle a request. Consider the following dateFormatItem:

<dateFormatItem id="yMMMd">d MMM y</dateFormatItem>

If the request is for yMMMMd, the above item can be automatically expanded to produce the pattern "d MMMM y" in response to the request. Of course, if the desired behavior is that a request for yMMMMd should produce something other than "d MMMM y", a separate dateFormatItem must be added, for example:

<dateFormatItem id="yMMMMd">d 'de' MMMM 'de' y</dateFormatItem>

We need to support that on .formatDate().

Any news on this topic? I wanted to use the skeleton "MMMM" with Globalize set to German, but I ended up with that exact same error message E_UNSUPPORTED: Unsupported {"feature": "year pattern u"}. If I set it to English, it works, though.
Any chance that this will be fixed anytime soon?

Hi @AndreR, #604 is stalled. Would you like to take it over? I'd be happy if you could address the comments in that PR. You could create a new pull request on top of that one with additional commits. Just let me know if you have any questions. Thanks

Hi @rxaviers, I would love to help you out here, but my Javascript skills are too basic. I'm sorry!


azure deploy vs code fail

Does this occur consistently?
Repro steps:

Action: appService.Deploy
Error type: Error
Error Message: Deployment to "sdkfacebookarsoft" failed. See output channel for more details.
Version: 0.16.4
OS: win32
OS Release: 10.0.17134
Product: Visual Studio Code
Product Version: 1.43.2
Language: en

Call Stack
Object.<anonymous> extension.bundle.js:1:519759
fulfilled extension.bundle.js:1:516898
processTicksAndRejections task_queues.js:85:5

@arsoftcr please check the output channel for errors. If that doesn't help, add repro steps and copy the output here


Allows users to request a semantic title for the embed with branding replaced

Changes
URL parameter sem added (e.g. https://fxtwitter.com/jack/status/20?sem).
If it's present in URL, the branding for FixTweet will be replaced with BRANDING_NAME_SEMANTIC.
Additionally, if User Agent is TelegramBot, DOMAIN_SEMANTIC will be appended to the beginning of the twitter:title metatag.
Purpose of change
This change aims to make search in messengers better for willing users
Tests
According tests were written:

Branding semantic name
Tweet semantic title for Telegram
Tweet semantic title for Telegram only

Very cute, that you actually did send me a pull request for this. However, this is a feature that no one has asked for, and it's not worth adding more env variables and code to accomplish this. FixTweet will contain the FixTweet name. Changing the name from FixTweet to Twitter may constitute as trademark infringement as we would then be an impersonator of the Twitter domain. I don't want our project to get into any legal trouble. So I believe it is in everyone's best interests to decline.

this is a feature that no one has asked for
Not a valid argument

it's not worth adding more env variables
Not a valid argument

FixTweet will contain the FixTweet name
Not a valid argument

Changing the name from FixTweet to Twitter may constitute as trademark infringement as we would then be an impersonator of the Twitter domain
The option is not in power by default. If you are afraid it will be used so widely, it contradicts your "nobody needs it" argument. If you are afraid of having twitter.com in your codebase, I'm afraid you already have a lot of matches for the Twitter trademark in your project.


Log server errors to a file

The server errors only log the error to an email sent to the site admins. Maybe we should log them to a local file on the server as well.

@cfpb/cfgov-backends Is this still an issue?

@anselmbradford I don't believe so. In production we log errors to syslog which goes to the local system and to other downstream listeners.


promtool command for dynamic retention

This would be a simple tool that hits the right endpoints based on a simple config-file that looks like this:
# The frequency at which tombstone cleanup needs to be run.
# This means the /clean_tombstones endpoint is hit every 1h
cleanup_interval: 1h
# The frequency at which the deletes need to be run.
# This means that the /delete_series endpoint is hit every 5mins for the below deletes.
delete_interval: 5m

deletes:
  - queries:
      - {__name__=~"job1_.*"}
      - {job="tempJob"}
    retention: 10h # The retention time of every series that matches the above queries.

@brian-brazil Are you ok with including this in promtool?

I'm not a fan of having anything in promtool require a config file (bar
validation/unittests), I think it should work entirely via the command line.
Nor do I think that promtool should be a daemon, as that's not very tool
like.
In relation to the particular feature I'd suggest having users use Cron for
a good while so we can see how this works out in terms of operations and
support rather than adding it to the core immediately.
On 27 Dec 2017 11:15, "Goutham Veeramachaneni"<EMAIL_ADDRESS>wrote:
This would be a simple tool that hits the right endpoints based on a simple
config-file that looks like this:
The frequency at which tombstone cleanup needs to be run.# This
means the /clean_tombstones endpoint is hit every 1hcleanup_interval:
1h# The frequency at which the deletes need to be run.# This means
that the /delete_series endpoint is hit every 5mins for the below
deletes.delete_interval: 5m
deletes:

queries:

{name=~"job1_.*"}
{job="tempJob"}
retention: 10h # The retention time of every series that matches
the above queries.

@brian-brazil https://github.com/brian-brazil Are you ok with including
this in promtool?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/prometheus/prometheus/issues/3628, or mute the thread
https://github.com/notifications/unsubscribe-auth/AGyTdq2BVa_JoGusBbnXiPGlqTDnbXo0ks5tEibfgaJpZM4RNaJs
.


ClinVar GRCh37 links missing variant id in URL

(requires modification to toml file for vcfanno in iobio gru backend)

This missing clinvar uid is due to a missing field in the vcfanno toml file for ClinVar (GRCh37 only):
I mistakenly missed including the ID vcfanno field for ClinVar GRCh37.  (It is correctly included for ClinVar GRCh38 vcfanno).
The ID field (bold) needs to be added to data/annotations/GRCh37/vcfanno_annotate_variants.toml:
fields=["CLNDN", "CLNSIG","ALLELEID","CLNREVSTAT","ID"]
names=["CLNDN", "CLNSIG","ALLELEID","CLNREVSTAT","CLNUID"]
ops=["self", "self", "self", "self","self"]

I can add it in. It will require a new data directory version, but only a small change since we're using hard links.  How time sensitive is this?

Thanks @anderspitman. This isn't time critical. If we can get this fixed in the next few weeks, that will be great.

@tonydisera this is what I'm seeing for the current file:
[[annotation]]
file="/iobio-gru-backend/static/clinvar/GRCh37/clinvar.vcf.gz"
fields=["CLNDN", "CLNSIG", "CLNREVSTAT","ALLELEID","CLNREVSTAT"]
ops=["self", "self", "self", "self", "self"]
[[annotation]]
file="/gru_data/annotations/GRCh37/gnomad/gnomad.genomes.r2.1.1.sites.iobio.slim.vcf.gz"
fields=["AC", "AN", "AF", "AF_popmax", "nhomalt", "DP", "AF_fin", "AF_nfe", "AF_oth", "AF_amr", "AF_afr", "AF_asj", "AF_eas", "AF_sas"]
names=["gg2_1_1_AC", "gg2_1_1_AN", "gg2_1_1_AF", "gg2_1_1_AF_popmax", "gg2_1_1_nhomalt", "gg2_1_1_DP", "gg2_1_1_AF_fin", "gg2_1_1_AF_nfe", "gg2_1_1_AF_oth", "gg2_1_1_AF_amr", "gg2_1_1_AF_afr", "gg2_1_1_AF_asj", "gg2_1_1_AF_eas", "gg2_1_1_AF_sas"]
ops=["self", "self", "self", "self", "self", "self","self","self","self","self","self","self","self","self"]
[[annotation]]
file="/gru_data/annotations/GRCh37/gnomad/gnomad.exomes.r2.1.1.sites.vcf.gz"
fields=["AC", "AN", "AF", "AF_popmax", "nhomalt", "DP"]
names=["ge2_1_1_AC", "ge2_1_1_AN", "ge2_1_1_AF", "ge2_1_1_AF_popmax", "ge2_1_1_nhomalt", "ge2_1_1_DP"]
ops=["self", "self", "self", "self", "self", "self"]

I'm worried I might apply the changes you described above incorrectly. Can you provide the exact file you want me to replace this with?

Sure thing. We are adding one more entry to fields and opts under the first annotation (clinvar) in the GRCh37 toml file. NOTE: We are also adding a row under this annotation for the names. My previous note was probably confusing b/c the field names were in a different order. I've corrected that.
So the clinvar annotation should look like this in the toml file:
[[annotation]]
file="/iobio-gru-backend/static/clinvar/GRCh37/clinvar.vcf.gz"
fields=["CLNDN", "CLNSIG", "CLNREVSTAT", "ALLELEID", "ID"]
names=["CLNDN",  "CLNSIG", "CLNREVSTAT", "ALLELEID", "CLNUID"]
ops=["self", "self", "self", "self", "self"]

Oh I think I see why I was confused. The CLNREVSTAT field is repeated in the old file so you're replacing that with ID, rather than adding a 6th one.

I am sorry @anderspitman ! Good eye. I didn't even notice that mistako!  I tested and the fix works as expected.


Removed "(Preview)" from header

Feature declared GA in August feature summary docs https://powerbi.microsoft.com/en-us/blog/power-bi-august-2024-feature-summary/

@maggiesMSFT
Can you review the proposed changes?
Important: When the changes are ready for publication, adding a #sign-off comment is the best way to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@maggiesMSFT
I'll merge this PR based on your approval. If this article requires further changes, please open a separate pull request.


define docker baseimage and tag

Fixes #240

@jkotalik @rynowak - See if this does the trick. Open to suggestions.


Results not complete for Common Crawl index 2012

This is related to the comment in issue #17.
The following code returns nothing:
cdx = cdx_toolkit.CDXFetcher(source='cc')
url = "www.cnn.com/*"
objs = cdx.iter(url, from_ts='201207', to='201212', filter=['status:200', 'mime:text/html'])

I also ran this code objs = cdx.iter(url, from_ts='201201', to='201206', filter=['status:200', 'mime:text/html']) and it returns some results. However, the results only contain data before 201207. So it seems the data between 201207 - 201212 are missing?
Similarly, objs = cdx.iter(url, from_ts='201301', to='201306', filter=['status:200', 'mime:text/html']) only returns data after 201304.

The crawling was not continuous.


Navbar is causing an bottom overflow in the website [BUG]

Describe the bug
The Navigation bar sticky prop is causing an bottom overflow.
Steps To Reproduce
Just scroll to the bottom of the page and keep scrolling.
Expected Behavior
The Scrolling should stop at the footer
Operating System
Windows 🪟
Browser
Google Chrome
Screenshots

Additional information
I already fixed the problem and will set up a pull request.

@Trickkyyy Thank you for opening the issue 😀!
I will check your PR shortly 🙂.


Help running simple example on Google Cloud Platform.

Any help? Do I need Kubernetes running to do docker-compose up on the simple example?
Thanks!
docker-compose up
Building application
ERROR: (gcloud.auth.docker-helper) There was a problem refreshing your current auth tokens: invalid_grant: Account has been deleted
Please run:

  $ gcloud auth login

to obtain new credentials, or if you have already logged in with a
different account:

  $ gcloud config set account ACCOUNT

to select an already authenticated account to use.
Traceback (most recent call last):
  File "site-packages/dockerpycreds/store.py", line 74, in _execute
  File "subprocess.py", line 336, in check_output
  File "subprocess.py", line 418, in run
subprocess.CalledProcessError: Command '['/usr/bin/docker-credential-gcloud', 'get']' returned non-zero exit status 1.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "site-packages/docker/auth.py", line 129, in _resolve_authconfig_credstore
  File "site-packages/dockerpycreds/store.py", line 35, in get
  File "site-packages/dockerpycreds/store.py", line 87, in _execute
dockerpycreds.errors.StoreError: Credentials store docker-credential-gcloud exited with "".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "bin/docker-compose", line 6, in <module>
  File "compose/cli/main.py", line 71, in main
  File "compose/cli/main.py", line 127, in perform_command
  File "compose/cli/main.py", line 1080, in up
  File "compose/cli/main.py", line 1076, in up
  File "compose/project.py", line 475, in up
  File "compose/service.py", line 358, in ensure_image_exists
  File "compose/service.py", line 1082, in build
  File "site-packages/docker/api/build.py", line 251, in build
  File "site-packages/docker/api/build.py", line 313, in _set_auth_headers
  File "site-packages/docker/auth.py", line 96, in resolve_authconfig
  File "site-packages/docker/auth.py", line 146, in _resolve_authconfig_credstore
docker.errors.DockerException: Credentials store error: StoreError('Credentials store docker-credential-gcloud exited with "".',)
[26331] Failed to execute script docker-compose

Hi Peter,
The examples all come with two examples - Docker compose/swarm and Kubernetes. These are separate examples depending on which system you're using. If you have Kubernetes, then don't use docker-compose, instead use kubectl create -f kubernetes.yml. If you re using docker-compose then it's got nothing to do with Kubernetes.
Here it looks like you don't have authentication setup for your gcloud. Have you tried running the recommendation in that error message: gcloud auth login ?
HTH,
Matt

The issue is why is gcloud auth login being triggered after doing 'docker-compose up'? I fully agree with you, triggering docker-compose should not require Kubernetes but I suspect it may be asking for it. Either way, this is the error I receive after I trigger docker-compose up.

Where is your docker client configured to deploy to?

A past gcp project. Does running the simple example require a docker registry to deploy to?

If you're deploying to kubernetes yes. If you have a docker server which can do build commands in compose files directly, then no.

Ok, how would I complete the Simple example using a docker server only? docker-compose up seems to ask for a Kubernetes install

If docker-compose up is asking for a Kubernetes install, it's because you've configured it to use a Kubernetes backend. I've not personally used gcloud, but I suspect that they've providing a Kubernetes API, not a plain docker API.
If you are talking to just a docker server, then docker-compose up is all you need to do.

Ok so my first observation is that there are a billion ways this can be set up on Google resources. Which are you using? E.G.
https://cloud.google.com/cloud-build/docs/quickstart-docker
https://cloud.google.com/community/tutorials/docker-compose-on-container-optimized-os
or some other ? Have you set up your project specifically for this example or are you reusing another one that you previously used for a Kubernetes example? I think we need to understand the environment because otherwise there are too many variables

I am trying to run the example locally, I'll investigate docker-compose default settings

Sorry for the run around. I found a config file at .docker/config.json that was messing me up. Deleted it and now it works fine :/
Its fairly obscure, but I am happy to add a note to the docs to watch out for this as a tiny part of my penance.

Hi Peter, no problems. Glad you got it working :)


Im2Col (OpExecutioner?) integer overflow

https://gist.github.com/yquemener/5bcfade9cafa7ff6bd23f03f5720e60e
Looks like integer indexing might be used somewhere here? This was produced with VGG and a large batch size (1000 examples).

Post code that reproduces this exception please. But yes, that looks like request for big array allocation somewhere
With best regards,
Vyacheslav K.

On Apr 16, 2018, at 10:42, Alex Black<EMAIL_ADDRESS>wrote:
https://gist.github.com/yquemener/5bcfade9cafa7ff6bd23f03f5720e60e
Looks like integer indexing might be used somewhere here? This was produced with a large batch size.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Hm... I assumed this would be easy to reproduce. Apparently not :/
        INDArray img = Nd4j.create(256, 32, 256, 256);
        INDArray im2col = Convolution.im2col(img, new int[]{64, 64}, new int[]{1,1}, new int[]{0,0});

Gives OOM as expected, but no overflow...
Exception in thread "main" java.lang.OutOfMemoryError: Cannot allocate new FloatPointer(1249869037568): totalBytes = 2G, physicalBytes = 2G

That's approx 1.2TB by my count :)
As for using VGG16 itself: I can crash the JVM with large input size (on 1.0.0-alpha), but can't reproduce it...
        ZooModel zooModel = new VGG16();
        ComputationGraph vgg16 = (ComputationGraph) zooModel.initPretrained();
        vgg16.outputSingle(Nd4j.create(1000, 3, 224, 224));

8:49:07,940 INFO  ~ Using cached model at C:\Users\Alex\.deeplearning4j\vgg16_dl4j_inference.zip
18:49:07,941 INFO  ~ Verifying download...
18:49:08,419 INFO  ~ Checksum local is<PHONE_NUMBER>, expecting<PHONE_NUMBER>
18:49:08,460 INFO  ~ Loaded [CpuBackend] backend
18:49:08,949 INFO  ~ Number of threads used for NativeOps: 8
18:49:09,219 INFO  ~ Number of threads used for BLAS: 8
18:49:09,225 INFO  ~ Backend used: [CPU]; OS: [Windows 10]
18:49:09,225 INFO  ~ Cores: [16]; Memory: [7.1GB];
18:49:09,226 INFO  ~ Blas vendor: [OPENBLAS]
18:49:23,156 INFO  ~ Starting ComputationGraph with WorkspaceModes set to [training: NONE; inference: SINGLE]
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x0000000069c6981e, pid=14708, tid=0x00000000000013f4
#
# JRE version: Java(TM) SE Runtime Environment (8.0_151-b12) (build 1.8.0_151-b12)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.151-b12 mixed mode windows-amd64 compressed oops)
# Problematic frame:
# C  [libnd4jcpu.dll+0x7e981e]
#
# Failed to write core dump. Minidumps are not enabled by default on client versions of Windows
#
# An error report file with more information is saved as:
# C:\DL4J\Git\dl4j-examples\hs_err_pid14708.log
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

https://gist.github.com/AlexDBlack/27e2eef07b747c8686355a897210c98b

Closing this as not reproducable - we can reopen if @yquemener runs into this again.

I was able to reproduce this using the benchmark repo, test case 2 (on native/cpu) here:
https://github.com/deeplearning4j/dl4j-benchmark/blob/master/dl4j-core-benchmark/src/main/java/org/deeplearning4j/sets/StandardMemBenchmarks.java
This was minibatch size 32... sizes 1-16 run fine.
o.d.n.m.MultiLayerNetwork - Starting MultiLayerNetwork with WorkspaceModes set to [training: SINGLE; inference: SINGLE], cacheMode set to [NONE]
o.d.m.BaseMemoryBenchmark - Inference test: Starting minibatch size: 1
o.d.m.BaseMemoryBenchmark - Inference test: Starting minibatch size: 2
o.d.m.BaseMemoryBenchmark - Inference test: Starting minibatch size: 4
o.d.m.BaseMemoryBenchmark - Inference test: Starting minibatch size: 8
o.d.m.BaseMemoryBenchmark - Inference test: Starting minibatch size: 16
o.d.m.BaseMemoryBenchmark - Inference test: Starting minibatch size: 32
Bad number of bytes requested for allocation: -595591168
o.d.m.BaseMemoryBenchmark - Hit exception for minibatch size: 32
java.lang.RuntimeException: Number of bytes for allocation should be positive
	at org.nd4j.nativeblas.Nd4jCpu$NativeOps.execCustomOpFloat(Native Method) ~[nd4j-native-1.0.0-SNAPSHOT.jar:na]
	at org.nd4j.linalg.cpu.nativecpu.ops.NativeOpExecutioner.exec(NativeOpExecutioner.java:1695) ~[nd4j-native-1.0.0-SNAPSHOT.jar:na]
	at org.nd4j.linalg.convolution.Convolution.im2col(Convolution.java:213) ~[nd4j-api-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
	at org.deeplearning4j.nn.layers.convolution.ConvolutionLayer.preOutput(ConvolutionLayer.java:348) ~[deeplearning4j-nn-1.0.0-SNAPSHOT.jar:na]
	at org.deeplearning4j.nn.layers.convolution.ConvolutionLayer.activate(ConvolutionLayer.java:392) ~[deeplearning4j-nn-1.0.0-SNAPSHOT.jar:na]
o.d.m.BaseMemoryBenchmark - Inference test: Starting minibatch size: 64
o.d.m.BaseMemoryBenchmark - =============================
o.d.m.BaseMemoryBenchmark - ===== Benchmark Results =====
o.d.m.BaseMemoryBenchmark - =============================


More fixes for DSL tests

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Warning: This coverage report may be inaccurate.
This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.

For more information on this, see Tracking coverage changes with pull request builds.
To avoid this issue with future PRs, see these Recommended CI Configurations.
For a quick fix, rebase this PR at GitHub. Your next report should be accurate.

Details

0 of 21 (0.0%)  changed or added relevant lines in 3 files are covered.
3 unchanged lines in 3 files lost coverage.
Overall coverage decreased (-0.005%) to 37.752%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/Kendrick/TestsModel5.class.st
0
7
0.0%

src/Kendrick/TestsModel6SpatialMap.class.st
0
7
0.0%

src/Kendrick/TestsModel6SpatialMapWithEntity.class.st
0
7
0.0%

Files with Coverage Reduction
New Missed Lines
%

src/Kendrick/TestsModel5.class.st
1
0.0%

src/Kendrick/TestsModel6SpatialMap.class.st
1
0.0%

src/Kendrick/TestsModel6SpatialMapWithEntity.class.st
1
0.0%

Totals

Change from base Build<PHONE_NUMBER>:
-0.005%

Covered Lines:
5488

Relevant Lines:
14537

💛  - Coveralls


Interesting bug

The bug shows up on Safari Version 11.1.2 (13605.3.8) and Firefox 60.0.1 (64-bit) but doesn't for Chrome Version 68.0.3440.75 (64-bit).
While in PATRIC (I was on a Phylogenetic Tree Tab for Buchnera in this case, but it works on anything really).  Go into any service (I used Phylogenetic Tree Builder) and click open a dropdown menu.  Either click the back button or swipe back while the dropdown is open.  The previous page will load, then the dropdown menu will appear.  You can select an item in the menu, the menu will disappear with the help information appearing.  If you click outside the menu, it just simply disappears.  Everything works normally after.

@Tinyman392 as you mentioned, this was not related to a specific service, so i will update the labels shortly. Do you still see this issue for the latest Firefox and Safari? I did not see it happen when I tested recently.

I'm still getting it in Safari 12.1.2 and Firefox 68.0.2.  Though it doesn't happen if you go back to the home page for whatever reason.  So say you go Organisms > Bacillus, then go to a service, click a dropdown, then go back (using the button or swiping), the menu should appear in the upper right hand corner still.
Still no issues in Chrome.  I have a feeling that both Safari and Firefox kind of cache the previous page(s) you were on and then use that, but the menu interferes with it.  When going back to the hope page, it looks like Safari (didn't test Firefox, sorry) refreshes the page which negates the entire bug.  It looks like Chrome seems to refresh the page as well (which negates the bug).

thanks for the detailed info, yeah, i'm seeing it in Safari now... like the way you jump from data viewing to service, then back to data viewing. :)
looks to me this is related to "back button" issue we experience from place to place. @dmachi do you have suggestion/insight on this?

from my testing, it looks like this happens as long as we have "data viewing to service, then back to data viewing", no matter what tab in data viewing and what service we are using.


Not working with newest Arduino - fixes

Not opening a PR because I noticed that you have your own fork of Arduino-Makefile project and maintain it.
Took me some time to figure it out but now it works.
First of all, with new SAMD devices, this will fail to compile and it requires changes in the README (might open a PR just for that).
For the SAMD boards, there is no need for BOARD_SUB, everything is stored in BOARD_TAG.
With the newest commits from the upstream repository, the example project will still not build due to missing LTO plugins.
Suggested change is as follows:
diff --git a/Arduino.mk b/Arduino.mk
index 5a04506..9258f0f 100644
--- a/Arduino.mk
+++ b/Arduino.mk
@@ -1073,6 +1073,9 @@ CAT     = cat
 ECHO    = printf
 MKDIR   = mkdir -p

+# SPECIAL WORKAROUND FOR LIBRARIES
+LTO_PLUGIN_DIR = $(HOME)/.arduino15/packages/arduino/tools/arm-none-eabi-gcc/7-2017q4/lib/gcc/arm-none-eabi/7.2.1/liblto_plugin.so
+
 # recursive wildcard function, call with params:
 #  - start directory (finished with /) or empty string for current dir
 #  - glob pattern
@@ -1698,7 +1701,7 @@ else
 endif

 $(CORE_LIB):   $(CORE_OBJS) $(LIB_OBJS) $(PLATFORM_LIB_OBJS) $(USER_LIB_OBJS)
-               $(AR) rcs $@ $(CORE_OBJS) $(LIB_OBJS) $(PLATFORM_LIB_OBJS) $(USER_LIB_OBJS)
+               $(AR) rcs $@ $(CORE_OBJS) $(LIB_OBJS) $(PLATFORM_LIB_OBJS) $(USER_LIB_OBJS) --plugin $(LTO_PLUGIN_DIR)

 error_on_caterina:
                $(ERROR_ON_CATERINA)

I did not find a way to replace the arm-none-eabi-gcc-ar with a C++ one so this requires the LTO Plugin to be included. Feel free to alter it. Also I opened a PR upstream to fix zeroing the board before flashing.

Thanks @JDuchniewicz
The LTO_PLUGIN_DIR = $(HOME)/.arduino15/packages/... doesn't look very cross platform as it does not exist on macOS.
Are those changes upstream already? If so, I'll just rebase my fork to get them.

I did not push the LTO_PLUGIN changes upstream as they are relevant only to this project - without including additional libs with the ar command (as is done normally) it does not complain. The one thing they did in the past was to replace the linking process with the g++ linker instead of gcc one.

I'm not sure how to do it in a future proof manner... As the versions will be changing and we have many platforms to serve. The easiest would be asking the user to provide it themselves but this might be asking for too much in some cases.


adopt to upcoming changes in LaxarJS Patterns resources

Due to LaxarJS/laxar_patterns#29 all usages of $scope.model need to be changed to $scope.resources.

Implemented on master (v1.6.0) and release-1.5.x (v1.5.0).


<EMAIL_ADDRESS>

@hector-hub-star


CSP inline style error when using ui-select

We are seeing two inline styles being applied when using the ui select directive, specifically with the ui-select-match directive. We are using the ng-csp directive at the top level and that is stopping inline styles. This error is happening on line 2888 of angular.js in version 1.5.8 (See tmp.innerHTML = wrap[1] + html.replace(XHTML_TAG_REGEXP, "<$1></$2>") + wrap[2];) We are using version 0.19.5 of ui select.
function jqLiteBuildFragment(html, context) {
  var tmp, tag, wrap,
      fragment = context.createDocumentFragment(),
      nodes = [], i;

  if (jqLiteIsTextNode(html)) {
    // Convert non-html into a text node
    nodes.push(context.createTextNode(html));
  } else {
    // Convert html into DOM nodes
    tmp = fragment.appendChild(context.createElement("div"));
    tag = (TAG_NAME_REGEXP.exec(html) || ["", ""])[1].toLowerCase();
    wrap = wrapMap[tag] || wrapMap._default;
    tmp.innerHTML = wrap[1] + html.replace(XHTML_TAG_REGEXP, "<$1></$2>") + wrap[2];

    // Descend through wrappers to the right content
    i = wrap[0];
    while (i--) {
      tmp = tmp.lastChild;
    }

    nodes = concat(nodes, tmp.childNodes);

    tmp = fragment.firstChild;
    tmp.textContent = "";
  }

Here is a console stack trace:

Refused to apply inline style because it violates the following Content Security Policy directive: "style-src 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-4IfJmohiqxpxzt6KnJiLmxBD72c3jkRoQ+8K5HT5K8o='), or a nonce ('nonce-...') is required to enable inline execution.
jqLiteBuildFragment @ lib.built.js:2889
jqLiteParseHTML @ lib.built.js:2921
JQLite @ lib.built.js:2966
JQLite @ lib.built.js:2962
removeComments @ lib.built.js:10195
(anonymous) @ lib.built.js:9609
processQueue @ lib.built.js:16384
(anonymous) @ lib.built.js:16400
$eval @ lib.built.js:17683
$digest @ lib.built.js:17496
$apply @ lib.built.js:17791
done @ lib.built.js:11832
completeRequest @ lib.built.js:12034
requestLoaded @ lib.built.js:11967

After some digging, it looks like there are two inline styles being applied in the match.tpl.html file and one inline style being applied in the select-multiple.tpl.html file.
For the match.tpl.html file:

Line 7 has an inline style of "outline: 0"
Line 11 has an inline style of "margin-right: 10px"

For the select-multiple.tpl.html file:

Line 24 has an inline style of "width: 34px"

Hi, did you solve this issue? I have the same problem but i don´t know how to solve it.

Hi @jcmorenoruiz - I think you can simply just remove the inline style attributes that I specified above from the ui-select file you are using if you don't want them (the styles there already aren't being applied due to the ng-csp directive). If you actually want to keep these styles, you can move them into a style sheet and apply them using class.

@corbinolds @jcmorenoruiz: in the above commit you find the proper patch.


Training Issues

(venv) root@094271c23dd5:/Codes-for-Lane-Detection-master/SCNN-Tensorflow/lane-detection-model# CUDA_VISIBLE_DEVICES="0" python3 tools/train_lanenet.py --net vgg --dataset_dir /CUlanes/
2019-02-16 15:52:02.422851: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 AVX512F FMA
2019-02-16 15:52:02.871202: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1356] Found device 0 with properties:
name: Tesla V100-PCIE-16GB major: 7 minor: 0 memoryClockRate(GHz): 1.38
pciBusID: 0000:18:00.0
totalMemory: 15.77GiB freeMemory: 14.52GiB
2019-02-16 15:52:02.871248: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1435] Adding visible gpu devices: 0
2019-02-16 15:52:03.280742: I tensorflow/core/common_runtime/gpu/gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2019-02-16 15:52:03.280792: I tensorflow/core/common_runtime/gpu/gpu_device.cc:929]      0
2019-02-16 15:52:03.280805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:942] 0:   N
2019-02-16 15:52:03.281169: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 13729 MB memory) -> physical GPU (device: 0, name: Tesla V100-PCIE-16GB, pci bus id: 0000:18:00.0, compute capability: 7.0)
I0216 15:52:03.285617 18902 train_lanenet.py:222] Training from scratch
2019-02-16 15:52:11.376766: W tensorflow/core/framework/op_kernel.cc:1318] OP_REQUIRES failed at whole_file_read_ops.cc:114 : Not found: laneseg_label_w16/driver_23_30frame/05151649_0422.MP4/00210.png; No such file or directory
2019-02-16 15:52:11.376889: W tensorflow/core/framework/op_kernel.cc:1318] OP_REQUIRES failed at whole_file_read_ops.cc:114 : Not found: driver_23_30frame/05151649_0422.MP4/00210.jpg; No such file or directory
I0216 15:52:11.377649 18902 tf_logging.py:116] Error reported to Coordinator: <class 'tensorflow.python.framework.errors_impl.NotFoundError'>, laneseg_label_w16/driver_23_30frame/05151649_0422.MP4/00210.png; No such file or directory
[[Node: data_augmentation/ReadFile_1 = ReadFile_device="/job:localhost/replica:0/task:0/device:CPU:0"]]
[[Node: data_augmentation/DecodePng/_37 = _Recvclient_terminated=false, recv_device="/job:localhost/replica:0/task:0/device:GPU:0", send_device="/job:localhost/replica:0/task:0/device:CPU:0", send_device_incarnation=1, tensor_name="edge_12_data_augmentation/DecodePng", tensor_type=DT_UINT8, _device="/job:localhost/replica:0/task:0/device:GPU:0"]]
2019-02-16 15:52:11.514239: W tensorflow/core/framework/op_kernel.cc:1318] OP_REQUIRES failed at whole_file_read_ops.cc:114 : Not found: driver_23_30frame/05171102_0766.MP4/00050.jpg; No such file or directory
2019-02-16 15:52:11.514288: W tensorflow/core/framework/op_kernel.cc:1318] OP_REQUIRES failed at whole_file_read_ops.cc:114 : Not found: laneseg_label_w16/driver_23_30frame/05171102_0766.MP4/00050.png; No such file or directory

I am unable to start training as its showing "no such file or directory". Any help would be great.

I have solved it.

@cardwing While I am training, the accuracy and accuracy_back is constantly at zero. I have checked the inputs and labels in train_gt.txt and they seem to be correct. Can you kindly assist me.

@cardwing Fixed it now. Thanks anyways :)

@amritpaul How did you solve the first problem?I'm facing the same problem in training,can you help me?


dashboard: reverse proxy support tls

What problem does this PR solve?

reverse proxy support tls

Release note
Check List
Tests

Manual test (add detailed scripts or steps below)

/rebuild

/rebuild

/merge


Input device name wildcard

Is it possible to specify a wildcard for an input device just like for output? For example I would like to have a generic config in which I disable pointer acceleration for every input device.
input * {
  pointer_accel -1
}

RTFM


Remove iceberg column stats

What type of PR is this：

[x] bug
[ ] feature
[ ] enhancement
[ ] others

Which issues of this PR fixes ：

Fixes #
Problem Summary(Required) ：
This PR is to fix bug of TPCH-100G Q21 on iceberg. It's because we are setting distinct value to 1 all the time. And query plan is like following

[FE PR Coverage check]
:disappointed: fail : 0 / 13 (00.00%)
file detail

path
covered line
new line
coverage

:large_blue_circle:
com/starrocks/external/iceberg/cost/IcebergTableStatisticCalculator.java
0
13
00.00%

@Mergify backport branch-2.2


Add a Gitter chat badge to README.md

angular/react-native-renderer now has a Chat Room on Gitter
@mlaval has just created a chat room. You can visit it here: https://gitter.im/angular/react-native-renderer.
This pull-request adds this badge to your README.md:

If my aim is a little off, please let me know.
Happy chatting.
PS: Click here if you would prefer not to receive automatic pull-requests from Gitter in future.

Badge will be added manually later.


Warn if a deployment is reaching the file count limit.

Maybe the CLI could warn when a deployment is near the limit of 10000 files? Something like:

Warning! Your deployment is generating 9000 files and it is close to the limit of 10000 files per deployment.

Please do this. And thanks @paulogdm for great help in the community.
For more info on why this is important see here: https://github.com/gatsbyjs/gatsby/issues/10457#issuecomment-499671372
or here: https://spectrum.chat/zeit/general/help-i-just-hit-a-deployment-limit-during-a-critical-deployment~6c7c0fb2-4822-4a54-9a20-fd9abb3d1f21

This limit has been lifted and the CLI does not error out anymore.

Has the limit truly been lifted? It's still listed on the Vercel website: https://vercel.com/docs/v2/platform/limits/#files


[Bug] Extra line of white pixels at the bottom of my gifs

Describe the bug
I'm getting an extra line of white pixels at the bottom of every gif I record.
To Reproduce

Set the height of the recording area to 400.
Record a gif.
Go to the Statistics tab.
It shows the Frame Size height as 401.

Expected behavior
The gif should have the exact dimensions specified before starting the recording.
Screenshots
Adding a progress bar puts it right at the bottom so you can see it has a different bottom to the rest of the gif:

The issue issn't caused by the progress bar though:

Desktop

OS: Windows 11
Version 2.41

Enabling Hide the title bar (thin mode) in the settings seems to have changed the behaviour to:

Set the recording area to 250x400.
Record a gif.
Statistics shows 250x400.
Go back to the recorder.
Now its size is 250x399.
Recording at that size stays there.

Setting the recorder interface to New mode has a similar problem: 250x400 is coming in as 249x399.

I get this same issue with this program and with another gif making tool called Licecap. It seemed to start when I started using a 1440p monitor vs 1080p, but I'm not 100% sure on that.

I'm on 1080p.
First time on Windows 11 though, I never had this issue in 10.

Oh yeah, that is to say, I also switched to Windows 11 around the time I started seeing this issue.

Which scalling/DPI are you two using?
The recorder has a hard time adjusting to pixel coordinations if the screen has a DPI different than 96 (scale different than 100%).

For example, on Windows 11 here, setting 500x300 created a correct recording.

I'm on 125% by default and I can confirm that 100% seems to fix the rounding errors for a few sizes I tried, though I never had this issue on my old Windows 10 computer which was also using 125%.

I'm experiencing this issue on Windows 10. Workaround has been just to crop the gif slightly at the bottom.


Pass MIME type of custom emoji to be uploaded

This ensures the media store on the Matrix side knows how to handle the emoji. Was able to use this change + https://github.com/turt2live/matrix-media-repo to get animated discord emoji bridging nicely.

Looks good, thanks for the PR!


Update api-implementation.md

I noticed a few minor issues in the opening sections of this article.

@MicrosoftDocs/patterns-and-practices-team-pr-reviewers

Can you review this PR?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.

#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@serpent5 please review the CLA requirements above and indicate your intent.  We cannot proceed until signed.  If you do not agree to the terms, simply close the PR.

@microsoft-github-policy-service agree

PnP #sign-off
#remove-label:"pnp-review-in-progress"
#remove-label:"do-not-merge"
#label:"ready-to-merge"


Configure kafka ui with docker compose single node

https://www.confluent.io/blog/kafka-client-cannot-connect-to-broker-on-aws-on-docker-etc/


Include python 3.12 as option

This version is now stable and should work with all of the requirements.

Hi @inkenbrandt! Thanks for opening the issue. Yes, it will probably work. Curious if you have some particular need for 3.12. Knowing that would help raise this as a priority. Cheers.


Allow RMSProp use same scaling as adam without momentum + make schedule_free_adamw use rmsprop directly (to spare one memory slot))

First part in #1019

Closed by #1019 and #1025


Codegen yields supposedly invalid ELF64 file

Current codegen works fine, but seems to produce an invalid ELF file.

readelf -a test.o outputs correct information about the file, everything is set correctly
objdump -d -j'.text' test.o complains about the file format not recognized because of a bad value, which isn't even pointed out
ld -o a.out test.o -e main complains with the same error as objdump
ld.bfd -b'elf64-little' test.o also complains about the file format not recognized
file test.o reports the file as being an executable ELF64 binary file

I basically don't get it at all. I believe my best bet is to read the source code of the BFD libraries and try to figure out what is going on. This is going to be a long and slow process, but I think it'll eventually lead me somewhere.
The biggest problem is why readelf does not complain about anything, while objdump and ld do. Maybe I am missing a segment to load the .interp section (which I do not have at the moment either)? This would be weird to call that a "bad value" though.
Anyway, I will try to isolate the issue and report any successful operations here.

I believe I can call this progress:
https://github.com/bminor/binutils-gdb/blob/712b8a0f68f2b24d554a83a1740fa06f7aec8952/binutils/readelf.c#L59
So readelf also uses the BFD libraries, but strangely accepts the input file.

There definitely is some kind of regression since we introduced symbols (commit d0e92ab14d47a3270c4fd4870c784321c5458e4d compiles fine and outputs correct data), as seen here:

output of readelf -a test.o:

ELF Header:
  Magic:   7f 45 4c 46 02 01 01 00 00 00 00 00 00 00 00 00
  Class:                             ELF64
  Data:                              2's complement, little endian
  Version:                           1 (current)
  OS/ABI:                            UNIX - System V
  ABI Version:                       0
  Type:                              EXEC (Executable file)
  Machine:                           Advanced Micro Devices X86-64
  Version:                           0x1
  Entry point address:               0x0
  Start of program headers:          64 (bytes into file)
  Start of section headers:          232 (bytes into file)
  Flags:                             0x0
  Size of this header:               64 (bytes)
  Size of program headers:           56 (bytes)
  Number of program headers:         3
  Size of section headers:           64 (bytes)
  Number of section headers:         3
  Section header string table index: 2

Section Headers:
  [Nr] Name              Type             Address           Offset
       Size              EntSize          Flags  Link  Info  Align
  [ 0]                   NULL<PHONE_NUMBER>000000  00000000
<PHONE_NUMBER>000000<PHONE_NUMBER>000000           0     0     0
  [ 1] .text             PROGBITS<PHONE_NUMBER>4001a8  000001a8
<PHONE_NUMBER>000001<PHONE_NUMBER>000000  AX       0     0     1
  [ 2] .shstrtab         STRTAB<PHONE_NUMBER>000000  000001a9
<PHONE_NUMBER>000011<PHONE_NUMBER>000000           0     0     1
Key to Flags:
  W (write), A (alloc), X (execute), M (merge), S (strings), I (info),
  L (link order), O (extra OS processing required), G (group), T (TLS),
  C (compressed), x (unknown), o (OS specific), E (exclude),
  l (large), p (processor specific)

There are no section groups in this file.

Program Headers:
  Type           Offset             VirtAddr           PhysAddr
                 FileSiz            MemSiz              Flags  Align
  PHDR           0x0000000000000040 0x0000000000000000 0x0000000000000000
                 0x00000000000000a8 0x00000000000000a8  R      0x8
  LOAD           0x00000000000001a8 0x00000000004001a8 0x00000000004001a8
                 0x0000000000000001 0x0000000000000001  R E    0x1000
  LOAD           0x0000000000000000 0x0000000000000000 0x0000000000000000
                 0x00000000000000e8 0x00000000000000e8  R      0x1000

 Section to Segment mapping:
  Segment Sections...
   00
   01     .text
   02

There is no dynamic section in this file.

There are no relocations in this file.

The decoding of unwind sections for machine type Advanced Micro Devices X86-64 is not currently supported.

No version information found in this file.

output of objdump -d -j'.text' test.o:

test.o:     file format elf64-x86-64

Disassembly of section .text:

00000000004001a8 <.text>:
  4001a8:	c3                   	retq

output of ld crt1.so ctri.so test.o -o a.out:

/nix/store/hrkc2sf2883l16d5yq3zg0y339kfw4xv-binutils-2.31.1/bin/ld: unknown architecture of input file `test.o' is incompatible with i386:x86-64 output
/nix/store/hrkc2sf2883l16d5yq3zg0y339kfw4xv-binutils-2.31.1/bin/ld: /nix/store/bpgdx6qqqzzi3szb0y3di3j3660f3wkj-glibc-2.31/lib/crt1.o: in function `_start':
/build/glibc-2.31/csu/../sysdeps/x86_64/start.S:101: undefined reference to `__libc_csu_fini'
/nix/store/hrkc2sf2883l16d5yq3zg0y339kfw4xv-binutils-2.31.1/bin/ld: /build/glibc-2.31/csu/../sysdeps/x86_64/start.S:102: undefined reference to `__libc_csu_init'
/nix/store/hrkc2sf2883l16d5yq3zg0y339kfw4xv-binutils-2.31.1/bin/ld: /build/glibc-2.31/csu/../sysdeps/x86_64/start.S:104: undefined reference to `main'
/nix/store/hrkc2sf2883l16d5yq3zg0y339kfw4xv-binutils-2.31.1/bin/ld: /build/glibc-2.31/csu/../sysdeps/x86_64/start.S:120: undefined reference to `__libc_start_main'

So this one seems to work correctly. We now have to track which commit specifically introduced the bug.

The issue can be tracked down until ab4ff91008264c6830c959e29aa92b4e5413fb37 at the moment (which is today at midnight).
It seems that introducing symbols was a mistake, or was poorly done. Let's try to strip the generated ELF file from the head of the codegen-elf branch, and see if the issue persists.
If yes, the symbol table is not at fault. Otherwise it is, and there either is something missing or the sh_info field generated is incorrect (I think it should refer to the number of symbols in the table, but I am not sure about it) or the section data is not at the right place.

The sh_info field of the .symtab section is supposed to contain the number of entries in the symbol table. However, I am fairly sure that I saw somewhere that we needed the number + 1, which is what I did. Funnily enough, readelf does not report that.
So the fix was just to remove that + 1, and everything worked like a charm.


JSON schema draft version

Hello, I can't find information on what version of draft specification you are using. Can you please clarify this and it would be cool to see this information in the README file.

Well, we are not actively following the spec changes, so we are still based on the specs from last year (like around may 2016 I guess), but if you think something need to be upgraded, you can post an issue about it.

The currently supported version is draft-04.

Thanks @fbessou :)

HI folks- I'm dropping in from the JSON Schema project.  We are re-organizing our implementations page to promote projects supporting at least draft-06, the first significant draft since the project was revived (draft-07 is compatible with draft-06 as a validator, while the forthcoming draft-08 will make it easier to defined things like UI form keywords as recognizable extensions to the standard JSON Schema keywords).
Draft-04 based projects will still be on our site, but not as prominently.

Thanks @handrews, good to know!


changes for jupyterlite-kernel

added new target for jupyterlite kernel
added FindSqlite3.cmake in dedicated cmake_emscripten folder:

this is needed since we use a non-custom installation of sqlite for the wasm build
cmake_emscripten is only included in wasm build

Added new magic commands for wasm build:

FETCH <URL> <FILENAME> : download a file / sqlite database and store it at the filename
SET_IDBFS_DIR <DIR>: set the directory which is "cached" / "persisted" to the IndexedDB
PUSH_TO_IDBFS : 'flush' content of persisted directory to IndexedDB

tiny bugfix in create since the index of the used token was off by one

@marimeireles the sql installation comes from the SQLiteCpp - installation.
This gives us the library and the headers, but is does not ship a proper cmake integration, this is why we need that here.
We could very easy write this FindSqlite thingy from scratch instead of using the copy pasted one since it only needs to work for the emscripten case and nothing else

but @marimeireles we can  also wait a bit with mering this since we are currently changing xeus itself a bit

but @marimeireles we can also wait a bit with mering this since we are currently changing xeus itself a bit

Not a problem for me, we can merge it now and then do a new PR once the changes upstream are in.

This gives us the library and the headers, but is does not ship a proper cmake integration,

I see. Cool. Was just wondering! :)
Thanks for your work here @DerThorsten.

This looks really useful :-) But if the database is large it means the browser will also take quite a hit memory wise, and network / download time wise.
An alternative approach for accessing large SQLite databases from in-browser SQLite engines is described in Hosting SQLite databases on Github Pages. To quote that post, it use "a virtual file system that fetches chunks of the database with HTTP Range requests when SQLite tries to read from the filesystem: sql.js-httpvfs."

@psychemedia, thanks for the input :)
I'll merge this PR and fix the CI on a next one.

@DerThorsten Do you have an example of using the magics to download and query data from a sqlite db located at a particular URL?
If I just try to run the %FETCH magic using this repo's Binder link, I get an error:
Error: Load a database to run this command.
If I create a database, the %FETCH runs without delay (too short a time for it to be blocking-running as it waits for the file to download) and then when I try the %LOAD I get an Error: The path doesn't exist.

@psychemedia there is no deployment of that feature yet.
Also it is not yet integrated in the jupyterlite kernel repo
But should not be too complicated to make the changes in the kernel repo by changing the Dockerfile
https://github.com/jupyterlite/xeus-sqlite-kernel/blob/c5fc770610453f0af80b6043fd430d96f9453a0d/Dockerfile#L188

Ah, ok, thanks... I must have misread the other thread that referred to this one..


'go install' fails on module path

$ go install github.com/chowder/duck-gen@latest
go: github.com/chowder/duck-gen@latest: <EMAIL_ADDRESS>parsing go.mod:
        module declares its path as: duck-gen
                but was required as: github.com/chowder/duck-gen

Fixed in https://github.com/chowder/duck-gen/pull/2
Thanks a lot @realtime-neil!

@chowder thank you!
$ date -uIseconds && go install github.com/chowder/duck-gen@main && echo BIG WIN
2023-08-04T14:18:00+00:00
go: downloading github.com/chowder/duck-gen v0.0.0-20230804141534-9c1f16e1c93f
BIG WIN


[XmlHttpRequest] xhr.upload.onprogress not working with xhr.send({uri: 'file:///...'})

I think, it's a bug
I'm trying to upload video with youtube v3 API, looking on this example.
So, I wrote something like this:
var xhr = new XMLHttpRequest();
xhr.open('PUT', this.url, true);
xhr.setRequestHeader('Content-Type', this.contentType); <=== video/mp4
xhr.setRequestHeader('Content-Range', 'bytes ' + this.offset + '-' + (end - 1) + '/' + this.filesize);
xhr.setRequestHeader('X-Upload-Content-Type', this.filetype);  <=== video/mp4

if (xhr.upload) {
  xhr.upload.addEventListener('progress', this.onProgress);
}
xhr.onload = this.onContentUploadSuccess_.bind(this);
xhr.onerror = this.onContentUploadError_.bind(this);
xhr.send({uri: this.file.path});  <=== file:///.....

and it works, i have xhr.onload and xhr.onerror and video file is uploaded to youtube and played there.
But i haven't xhr.upload.onprogress.
I try xhr.onprogress, xhr.upload.onprogress, xhr.upload.addEventListener - all of this not works.
BUT!
When i use FormData
let data = new FormData();
data.append('File', {
      uri:  source.path,
      type: source.type,
      name: source.name
});
var xhr = new XMLHttpRequest();
  xhr.open('PUT', this.url, true);
  //xhr.setRequestHeader('Content-Type', this.contentType);
  //=== comment this, because it throw error 'multipart != video/mp4'
  //xhr.setRequestHeader('Content-Range', 'bytes ' + this.offset + '-' + (end - 1) + '/' + this.filesize);
  //=== comment this, because sending data size != filesize
  xhr.setRequestHeader('X-Upload-Content-Type', this.filetype);

  if (xhr.upload) {
    xhr.upload.addEventListener('progress', this.onProgress);
  }
  xhr.onload = this.onContentUploadSuccess_.bind(this);
  xhr.onerror = this.onContentUploadError_.bind(this);
  xhr.send(data); <==== FormData

xhr.upload.onprogress is working. But then youtube api return processing error, because it support only 'video/*' and 'application/octet-stream' and does not support 'multipart/form-data'.
What I do wrong and what I need to do for using xhr.upload.onprogress WITHOUT FormData?
P.S. sorry for my ugly english

react-native v0.47.2:
node v8.2.1:
npm v5.3.0:

Target Platform: Android
Development Operating System: MacOS
Build tools: Android SDK

At this point this doesn't seem like a particular bug in React Native. The issue may be in your own JavaScript code. I know it's frustrating to see your issues closed but I recommend working on this a bit more, and letting us know if you find that this is definitely an issue that occurs due to a bug in React Native itself. Thanks for understanding.

@1stman: try putting your xhr.upload.onprogress definition before you do your xhr.open. That may help.


Update client3:circe, client3:core to 3.9.8

About this PR
📦 Updates

com.softwaremill.sttp.client3:circe
com.softwaremill.sttp.client3:core

from 3.4.2 to 3.9.8
📜 GitHub Release Notes - Version Diff
Usage
✅ Please merge!
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

⚙ Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "com.softwaremill.sttp.client3" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "com.softwaremill.sttp.client3" }
}]

labels: library-update, early-semver-minor, semver-spec-minor, commit-count:1

Superseded by #249.


name change  to EnTK

Vivek -- What are current plans for the change of name to EnTK?

The name has been changed in the development branches to 'radical.entk'. It remains 'ensemblemd' in the master and release. With the next release, the name will be changed completely(including repo name).

This is fixed in the latest release.


Pass Form SS to children as a prop

Hey man! Great work with the package.
So, this is a thing that I needed to get the field errors using the form's schema within the children.
Would be nice to have this on the official version.

@coniel ? any hint?

Hey, sorry, been super busy these past few days. This is great, thanks a lot! I see you also changed the way the form data is retrieved on submit. I like your solution (it also looks like it will fix an issue I just discovered when passing a doc into the form for update forms). I just want to check that it works on all inputs in both the Semantic UI and Material UI versions before merging (which one are you using btw?).
I need to do some work on displaying error messages. As you've probably noticed, at the moment it just displays whatever Simple Schema returns. So for any error besides "required" it's pretty useless. If you're able to help with that I would appreciate it a lot!

Thanks for giving feedback!
I'm using my own UI components, so neither Semantic or Material. For error messages, this is how I'm doing with my components:
import React from 'react';

const Field = React.createClass({
 getSSError(){
   return this.props.error && this.props.formSchema
             .messageForError(this.props.errorText, this.props.name);
 },

 render(){
   return (

       {this.props.label}
       <input
         type={this.props.type || 'text'}
         name={this.props.name}
         placeholder={this.props.placeholder}
       />
       {this.getSSError()}

   );
 }
});

export default Field;

Hey, I'm creating a package from my Field component that depends on this changes. It will be like afQuickField.

Cool, I haven't been able to merge this yet because it actually break some input components in both Semantic UI and Material UI so I'll have to fix those first (I'll get around to it today or tomorrow). Let me know when the package is usable and I can list it in the docs here.

Ooh, get it. I don't tested it with Semantic neither Material.

Finally got this in, thanks a lot for your work! I could use a collaborator on the package. Would you be interested?

Awesome, man!
I also started passing down schema with context and field definitions. So the Field components won't need to be a direct child of Form. They can just use this.context.formSchema and this.context.formFieldDefinitions[ this.props.name ] to reactively access errors and default values and these stuff.

mmm but I think that I polished more that in another branch of my fork because I needed it quicker


Staker rewards script: Check unbonded value withdrawals

Refs: #602
Depends on: #632
So far, the ETHUnbonded value for each operator has been determined by calling the KeepBonding.availableUnbondedValue method at interval start block. However, that approach ignores the operator's unbonded value withdrawals that occurred within the given interval. This pull request changes this by introducing some logic which takes those withdrawals into account and produces a more accurate result.

Generated report for interval<PHONE_NUMBER> -<PHONE_NUMBER>  and compared numbers against transactions referenced here. Works as expected.


Fix HTTP response code logging

We were noticing that 400/500 responses didn’t seem to be getting logged correctly. Having tested locally this improves things. So the middleware runs before the main handler, but attaches a listener to log when the request completes. This seems to do the right thing and I now see 200,
400 and 500 responses logged correctly locally.

I tweaked the dashboard to filter on CODE and verified that I can now see 400s show up distinctly:

Thanks for the reviews. Yeah the CODE graph looks a bit wacky because it's such a low volume of requests. I think it proves the status codes are getting through correctly!

Thanks for the reviews. Yeah the CODE graph looks a bit wacky because it's such a low volume of requests. I think it proves the status codes are getting through correctly!


Consider removing dependency on CustomValidatorBean

It is used in few places in BindingService. At the moment it i just a placeholder as I will fill it with more details later on.

Closing it it for now since initial trigger for raising it was misleading


404 error for js/build.js in spa-index.html

The path to the build.js file is wrong in spa-index.html

This was resolved by #58.
For future reference, "Fixes #57" would have auto-closed it while "Fix issue #57" just made a reference to it.


No transactions when sending tokens to a friendly bot in a demo mode

UI Version: 0.9.4
Description: No transactions when sending tokens to a friendly bot in a demo mode

Start Voyager
Click "Try Demo"
Sign in, Next
In Wallet, click "Send" button on any token from your balance
Specify the number of tokens and an address of a friendly bot (from the tip at the bottom of the form) as cosmosaccaddr1p6zajjw6xged056andyhn62lm7axwzyspkzjq0
Click "Send Tokens" button
Confirm a transaction, see a green successful message

Exptected: See new transactions on Transactions page
Actual: Transactions page is empty

This is fixed in the next release. Stay tuned.

Fixed in https://github.com/cosmos/voyager/releases/tag/v0.10.1.


Dedupe Goldsky data on GCS

Describe the feature you'd like to request
Import of the goldsky data into GCP needs to be deduped.
Describe the solution you'd like
As efficiently as possible, we should dedupe the goldsky data for any given data source.
Describe alternatives you've considered
N/A

From Reuven
didn't even work as i was expecting... the ordering of the files is even jankier than I expected. so based on their file format... originally I thought I could take things in batches easily... because i assumed the format was
--<batch_number>-<page_number>.parquet
Instead the format is:
---.parquet
And ALL of the works constantly write. I'm not sure if the  values are consistent
like does checkpoint 0 mean the same time to all workers?
because i was originally mass importing into bigquery that way
but because the flat files also then don't have the insert_time in the value... i'd need still one more bit of info to do the merging... that being said, i have a way to do this through dbt by using bigquery _TABLE_SUFFIX special variable if i knew that the checkpoints were consistent
but not entirely certain how efficient/inefficient that merge will be if the backfill is sufficiently disparate

Current status. If we can get access to someone's database or data warehouse, we can Airbyte replicate without any of this mess. Trying to make that happen

PR: https://github.com/opensource-observer/oso/pull/1292

Follow-on work here
https://github.com/opensource-observer/oso/issues/1293


Deployment groups - misses doc for "Update targets"

The documentation on deployment pools doesn't explain the Update targets function.

The function should both be mentioned and also given a clear answer about the new version (probably the one delivered with the current TFS version) and the requirements needed for the update to work (probably internet access for the current agent to https://vstsagentpackage.azureedge.net)

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 3b38c265-be4c-b038-e3a9-783a5e5ce659
Version Independent ID: 67da69da-3651-a8f4-f06a-c35aa3aa98fc
Content: Deployment groups in Release Management
Content Source: docs/pipelines/release/deployment-groups/index.md
Product: devops
GitHub Login: @alexhomer1
Microsoft Alias: ahomer

Thank you for your feedback. I have passed this on to the product team for advice.

Thank you for the feedback, update agent, forces the agent upgrade on the target
We will get the docs updated to include it.

As far as I can tell, this feature still isn't documented anywhere. Has any progress been made on this?

Hello team, Is there any progress on this request? I cannot find any doc about this topic


Is Fold not compatible with tensorflow-1.4.0?

As what I found above, I want to get the latest version of fold. But whenever I use bazel 0.5.4 or 0.8.1, I always got this error that I have never found before, which says
ERROR: /home/kazuhiradz/fold/tensorflow_fold/llgtm/BUILD:35:1: no such package 'base': BUILD file not found on package path and referenced by '//tensorflow_fold/llgtm:platform_google'.
ERROR: Analysis of target '//tensorflow_fold/llgtm:platform_google' failed; build aborted.
I skip this test and make the wheel successfully. But when I installed tensorflow-1.4.0rc and tensorflow-fold by source. It occurred:
tensorflow.python.framework.error_impl.NotFoundError.
Even when I installed tensorflow back to 1.0.0 it still doesn't work
I am not sure what the problem is.

Did you manage to install it with tensorflow 1.4.0? I am using it with v1.0 but I need a newer version.