[wip] ensure prerequisites for nokogiri are installed

Why do we need nokogiri for rspec-expectations? I thought we only needed it for rspec-rails.

@myronmarston I think it's coming from the rspec-core build in this instance (which will use it for validating the html formatter) but it's failing the build here, my goal was if this worked would be just to add the prerequirests (libxml2) to all the travis builds...

Thanks for explaining.  I hadn't seen the build failures yet.
It looks like Nokogiri <IP_ADDRESS> was released today; given this is a new problem, my guess is that it's only a problem on <IP_ADDRESS>.  A simple solution might be to lock nokogiri in rspec-core's gemfile to < <IP_ADDRESS>.

Fixed by pinning nokogiri instead, FWIW it's apparently an issue with docker (which travis uses under the hood IIRC) and nokogiri, hopefully they'll fix it :/


downgrade packer to 1.9.2

Downgrade Packer to 1.9.2, the last version from BUSL was taken into use. Eventually Packer will be replaced completely.

/override test-integration-metal3-dev-tools-centos test-integration-metal3-dev-tools-ubuntu
These don't test the Dockerfile change, skip.


Extraced JPEG from PDF is much smaller

Sharp Version: 0.27.2
What are the steps to reproduce?

Compile libvips 8.10.6 with Pdfium 4455
Load a PDF with sharp
Extract a JPEG via jpeg({quality: 100})

The Problem is that the extracted JPEG is much smaller than the original JPEG.
What is the expected behaviour?
The extracted JPEG should have the same width and height as the original JPEG.
Are you able to provide a minimal, standalone code sample, without other dependencies, that demonstrates this problem?
const sharpImage = sharp(pdfPath, {
  page: 1,
  pages: 1,
  limitInputPixels: false,
});
sharpImage.jpeg({quality: 100});

Are you able to provide a sample image that helps explain the problem?
The original JPEG:

The PDF:
Example.pdf
The extracted JPEG:

What is the output of running npx envinfo --binaries --system?
  System:
    OS: Linux 5.4 Debian GNU/Linux 9 (stretch) 9 (stretch)
    CPU: (4) x64 Common KVM processor
    Memory: 3.63 GB / 15.64 GB
    Container: Yes
    Shell: 4.4.12 - /bin/bash
  Binaries:
    Node: 14.16.0 - /usr/local/bin/node
    Yarn: 1.22.5 - /usr/local/bin/yarn
    npm: 6.14.11 - /usr/local/bin/npm

Incresing the densitive within the constructor helps, but it increases the JPEG size strongly. Perhaps is PDFium the reason.

Incresing the densitive within the constructor helps, but it increases the JPEG size strongly.

You're correct in that the density setting is what you'll need to alter when converting PDF-based input to a bitmap output. The use of quality: 100 is probably too high for this image as it looks like the original was compressed with a "quality" of ~90.
It also looks like this sample PDF file has x-ppi and x-ppi metadata that might not be correct, so this could be an encoding problem, or possibly a pdfium decoding problem too.
$ pdfimages -list Example.pdf
page   num  type   width height color comp bpc  enc interp  object ID x-ppi y-ppi size ratio
--------------------------------------------------------------------------------------------
   1     0 image     960   640  rgb     3   8  jpeg   no        25  0   301   300  301K  17%

Thank you for your fast reply.
Indeed, it was the PDF which was causing the problem. Trying out the same operation on a different PDF seemed to solve the problem.


400 Error with "http://localhost:8080/wrk2-api/post/compose" get request

GET http://localhost:8080/wrk2-api/post/compose
General
Request URL: http://localhost:8080/wrk2-api/post/compose
Request Method: GET
Status Code: 400

I have deployed social network microservices successfully, but when I checked Jaeger via http:/localhost:16686/ , "400" error showed. Then I tried "curl http://localhost:8080/wrk2-api/post/compose" manually by Restape, still get 400 error.

edit the IP address to localhost in wrk2/scripts/social-network/compose-post.lua

Got it. Thanks. Another question, I have no idea how to use http://localhost:8080/index.html. When I logined with one if registered username, then click Compose  Post, it doesn't respond when I submit socfb-Reed98.mtx
已从 Outlook Mobilehttps://aka.ms/blhgte 发送

From: Fatima Tahir<EMAIL_ADDRESS>Sent: Saturday, May 2, 2020 9:02:42 PM
To: delimitrou/DeathStarBench<EMAIL_ADDRESS>Cc: Linda Wang<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [delimitrou/DeathStarBench] 400 Error with "http://localhost:8080/wrk2-api/post/compose" get request (#54)
edit the IP address to localhost in wrk2/scripts/social-network/compose-post.lua
―
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/delimitrou/DeathStarBench/issues/54#issuecomment-622950399, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AB7Q5X432SQM5CYOU4O2NATRPQKXFANCNFSM4MVJ3DCQ.

Will social network microservice be supported on centos in the near  future? Thanks
已从 Outlook Mobilehttps://aka.ms/blhgte 发送

From: wang wulin<EMAIL_ADDRESS>Sent: Thursday, May 7, 2020 3:07:13 PM
To: delimitrou/DeathStarBench<EMAIL_ADDRESS>delimitrou/DeathStarBench<EMAIL_ADDRESS>Cc: Author<EMAIL_ADDRESS>Subject: Re: [delimitrou/DeathStarBench] 400 Error with "http://localhost:8080/wrk2-api/post/compose" get request (#54)
Got it. Thanks. Another question, I have no idea how to use http://localhost:8080/index.html. When I logined with one if registered username, then click Compose  Post, it doesn't respond when I submit socfb-Reed98.mtx
已从 Outlook Mobilehttps://aka.ms/blhgte 发送

From: Fatima Tahir<EMAIL_ADDRESS>Sent: Saturday, May 2, 2020 9:02:42 PM
To: delimitrou/DeathStarBench<EMAIL_ADDRESS>Cc: Linda Wang<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [delimitrou/DeathStarBench] 400 Error with "http://localhost:8080/wrk2-api/post/compose" get request (#54)
edit the IP address to localhost in wrk2/scripts/social-network/compose-post.lua
―
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/delimitrou/DeathStarBench/issues/54#issuecomment-622950399, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AB7Q5X432SQM5CYOU4O2NATRPQKXFANCNFSM4MVJ3DCQ.

@mywulin as of now we don't have concrete plans to support it on centos, sorry. If you run into specific issues though feel free to post here.

We are still working on the frontend and will release it shortly. You are recommended to use the HTTP APIs for now. We are not planning to support centos, but you are free to build your own images with any base image.


add "full-venv" argument to make shared libs optional

@pfmoore This PR adds the command line option to use the full venv rather than the shared libs. However I am a little conflicted as to whether we should merge this change.
It makes the code and API more complicated, and in general I want to keep the complexity low by using sane defaults and avoiding supporting corner use-cases. I'm not really sure why someone would not want to use shared libs, and therefore it seems like a corner case that maybe we shouldn't support. What do you think?
In this PR:

add flag --full-venv for install, reinstall-all, and run commands
updated docs

Not in this PR:

unit tests for —full-venv flag

Agreed. In my mind, the only real reason for having the option was the possibility that the shared libs approach didn't work for someone, and having the option gave them a way out. But realistically, if it doesn't work for some people, we'd just revert, and doing that would likely be a better option anyway.
And actually, having two options, and consequently two code paths to test, probably adds more risk than just going with the clean implementation.
So I'm fine with just going all-in and skipping the option.

And actually, having two options, and consequently two code paths to test, probably adds more risk than just going with the clean implementation.

Very true!


Support for HyperTerm

Hi,
would be nice if shuttle would also support HyperTerm, next to iTerm and Terminal.app.

Does it support AppleScript?

https://github.com/zeit/hyperterm/issues/540 Once it supports apple script I could look into this.

Closing for now... when HyperTerm gets apple script support we can revisit.

I did some digging in the electron issues and found this. https://github.com/electron/electron/issues/4418 seems that this is not happening anytime soon.


Fix incorrect return type in doc-comment

Method returns a Table not a Dataset. This throws off IDEs and leads users to dive into the documentation to work out why they can't do:
        $table = $dataset->table($tableName);

        $job = $table->load(...)

@googlebot I signed it!

Thanks for the contribution @bencromwell!


Added syntax highlighting for Squirrel

https://github.com/search?utf8=✓&q=extension%3Anut+NOT+nothack&t
ype=Code
Squirrel is already detected by GitHub but has no syntax
highlighting.

Excellent, thanks for that!
As I mentioned in my e-mail, the failure regarding byebug relates to a separate issue that will be remedied by #3790. In the meantime, just sit tight and wait patiently. ;-)

@mathewmariani CI should start passing once you pull the current linguist/master into your branch.


NavigationExperimental Android header title horzontal placement

Issue Description
https://material.google.com/layout/structure.html#structure-app-bar
The Android default ActionBar behavior is to have left padding of 72 based on the link above.
Is there a way in navigationalExperimental to either horizontally center the header title or total left align (get rid of left padding for certain routes)?
or can navigationExperimental have consistent styles from IOS to Android?
https://github.com/facebook/react-native/pull/3028

React Native version: 0.33
Platform(s) (iOS, Android, or both?): Android
Operating System (macOS, Linux, or Windows?): OSX

What do you think is the most sane default that would fit in with native Android apps?
A pull request would be appreciated for this!

@ericvicenti Thank you for your reply!
The way its defaulted now (left align, with left padding of 72dp) is Native Android standard so it's definitely the most sane default.
It'd be nice to be able to customize the horizontal alignment of the Android Header title in any direction when needed or on demand. A use case would be, I'd like to center align the Android navigation header to create a consistent design between Android and ios.

Would the height and other styles of the header match iOS, or just the text alignment? In either case, you may want to fork the header component and customize it for your needs.
If you want to add a title alignment prop that makes sense for both platforms, we can consider implementing it in NavigationHeader, but it may be tricky because of all the animation going on.

<NavigationHeader.Title textStyle={styles.navHeaderTitle}>
  navHeaderTitle: {     color: '#ffffff'     fontFamily: Font.mainBold,     fontSize: 20   },
@ericvicenti The header text alignment seems to be the only thing needed. I'm passing in a style to the Navigation.Title component from the example above which handles text size, family, etc. If I apply textAlign: 'center' to this, it doesn't work, at least for Android.
A titleAlignment prop in the NavigationHeader component would be ideal in this situation which would control the horizontal alignment for both platform if provided. If not, defaults to it's native standard implementation.

Are there cases where one page needs center text and other pages need left-alignment? That would make things more difficult

No not in our case. We'd like to keep all of the navigation title consistent throughout the app so it's ideal to just have all of our views header titles to be centered on Android.

Ok. Are there any changes needed to the header or the title?

Just the horizontal alignment for the header title text as stated.

Oh I misunderstood and thought the style prop was working for you.
Feel free to implement the titleAlignment prop for NavigationHeader as you need, we will happily accept the change!

To be honest, I'm not to sure how to implement this to override the default android header text alignment. Could you provide some direction on how go about implementing this props?

You can play around with the View and Text styles in NavigationHeader and NavigationHeaderTitle

Passing in that style property textAlign: 'center' to NavigationHeader.Title is working now  in Android. Don't think it's necessary to create a NavigationHeader prop to do this anymore after looking deeper into the header code. @ericvicenti Thank for the guidance!


GUI web-proxy writes bad squid-conf

In "Proxy Auto-Config" --> Rules / Matches / Proxies the GUI does not accept "-" in Names and Descriptions. Clicking save the GUI is hanging several Minutes but does not save the settings.
In Forwarding Proxy ("Weiterleitungsproxy"), configured Ports  are not saved and not written to the squid.conf.
In General Settings ("Allgemeine Proxyeinstellungen")  clicking apply causes hanging the GUI for several minutes but squid is not starting.
In cache.log i find that:
"FATAL: No HTTP, HTTPS, or FTP ports configured
Squid Cache (Version 3.5.28): Terminated abnormally."

Version is 19.1

@fichtner the can go back to one of you as my part (1) is done (the others are unrelated)

@steffda I can't reproduce 2. -- it's true that they are not written when you don't have an interface selected, but that's expected. 3. would point to the same issue but I also cannot reproduce.

I can not select any interface. I can write one into the GUI-field, but it does not take it.

You can only use static interfaces there. They will show up automatically.

I have only one physical Interface on my Server, thats WAN. This is not offered by the GUI.
In between i could create a VLAN on the WAN-Interface and then the offered in the interfaces-section a interface called OPT1 which is assigned to VLAN.
This OPT1 the is offered in the squid preferences, but squid does not work.

What matters here is your configuration of Interfaces: [WAN] and [OPT1]
"IPv4 Configuration Type" and/or "IPv6 Configuration Type" need to be set to static IP addressing.

Specifying http_port 3128 in the config will listen to all addresses.  I see this as an adequate default when no interfaces are selected, since you would still need to open explicitly the port in the firewall rules when not using the default LAN->WAN ruleset.  With the default LAN->WAN ruleset you are only exposing this on the internal interfaces anyway.
With using http_port 3128 you also open the possibility of using an IP Alias on lo0 to reach the Squid service.  When you have multiple internal interfaces but want to use the same address for all, the current interface options are only for the assigned interfaces with static config.  As lo0 doesn't get assigned, but can host IP Aliases, the current configuration engine template rendering means you can't use a service address on lo0.
Contrast the current behavior with the Unbound DNS configuration where you can bind to all when no interfaces are selected and you can then utilize an IP Alias on lo0 to serve as your DNS address for all internal networks.  Have the option of using http_port 3128 in the config when no interfaces are selected would be consistent with other services as well, and cut down on some of the confusion that can arise when behavior is different.

@darrelclute if you want to suggest a feature please do not recycle support tickets. I'm closing this particular issue after no more feedback.


Exception has occurred: TypeError: Cannot assign to read only property 'name'...

Describe the bug
Exception has occurred: TypeError: Cannot assign to read only property 'name' of function 'function generateUUID(value, namespace, buf, offset) {
    if (typeof value === 'string') {
      value = strin...<omitted>... }'

How to reproduce
I'm not what to put here, this is throwing the error referencing my main JS file, but that file has no reference to the uuid functions.
Expected behavior
To not give this error lol.
Runtime
Node.js 14.15.5

This is weird. We have guard for this. https://github.com/uuidjs/uuid/blob/master/src/v35.js#L57-L61
Which version of uuid do you use?

I just releaized the try catch in the lib, i had caught exception on in my bebugger, my apologies.

Is this really necessary? Even when not using v35 I get this super annoying error all the time when running with debugger

Is this really necessary?

Good question.  The try-catch was added to address #268.
As for why name is set, that was added at my request in the original PR to "Set function name shown in debuggers". See https://github.com/uuidjs/uuid/pull/217#issuecomment-326404919.   Without this, v3 and v5 would both show up in stacktraces as generateUUID.
I.e. it's basically for cosmetic reasons when debugging code that calls v3 or v5 and is not strictly necessary.
... and relatively few people use v3 or v5.  (I think it's something like 1% of uuid users?)
That said...

Even when not using v35 I get this super annoying error all the time when running with debugger

If you're not using v35 and you're code uses ESM imports, a tree shaking bundler (e.g. parcel/rollup/webpack) should remove this code.

This code is only called (twice) on module load, not each time a uuid is created.  And if you've set your debugger to pause on caught exceptions (which is the only time this is an issue, right?) I expect this is hardly the only place you're running into this issue.  Wrapping feature-specific code in a try-catch is standard practice.  It's done all the time, in all sorts of modules.  While I agree it's frustrating (on the rare occasions there is reason to break on caught exceptions), the problem is by no means specific to uuid.  I.e. It kinda comes with the territory.

Is this really necessary? Even when not using v35 I get this super annoying error all the time when running with a debugger

Same here, any way around it?
I'm trying to connect to Cosmos DB with @azure/client and this is what happens as soon as I hot the API that I have there.

Exception has occurred: TypeError: Cannot assign to read only property 'name' of function 'function generateUUID(value, namespace, buf, offset) {
var _namespace;
if (typeof value === 'string') ...<omitted>... }'

at v35 (C:\LANGCHAIN\node_modules\uuid\dist\v35.js:73:23)
at Object. (C:\LANGCHAIN\node_modules\uuid\dist\v3.js:14:27)
at Module._compile (node:internal/modules/cjs/loader:1254:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1308:10)
at Module.load (node:internal/modules/cjs/loader:1117:32)
at Module._load (node:internal/modules/cjs/loader:958:12)
at Module.require (node:internal/modules/cjs/loader:1141:19)
at require (node:internal/modules/cjs/helpers:110:18)
at Object. (C:\LANGCHAIN\node_modules\uuid\dist\index.js:63:34)
at Module._compile (node:internal/modules/cjs/loader:1254:14)


Tour of Heroes - HTTP - create method for HeroService never defined

In the Tour of Heroes, the HTTP page has a section called "Add a hero" where the user makes a new button that will create a new hero using a name entered in an input field on the Heroes page of the application. However when following the steps in the tutorial it doesn't work because they never tell you to add the create method to the HeroService class, which means that when the Add button is clicked the function being called doesn't exist. Now looking at the bottom of the page will show the method, and looking at the Plunkr page also has the method, but you should add the create method to the explanation for that section.

If no one else is working on this, I can submit a fix for this issue.


Dose FasterRCNN should provide feature_extractor as ssd have ?

In the project, Could not find the feature_extractor of pre-trained weights for faster-rcnn, Dose it will have effect on the training result ?

I find it.


DinoDex v1

Overall, great job. I like the design of this solution and each class is organized very well. I'd like to see how many lines we can shave off with a refactor. Take a look at my notes and apply those tips to try and slim down the code a bit more.

@Manbearpixel Please take a look at Dustin's comments, refactor and submit a second iteration.


RequestParameterInitializable

Feature: RequestParameterInitializable

Author(s): Joannis Orlandos

Introduction
QueryParameters are widely used for applying filters to the requested data within the URL. The filtering functionality of the parameters on a request is not only useful for creating filters in a REST API. But also on pages where data can be filtered server side. Be it a table or blog. The paginate functionality is usually based on Parameters. Although there's no transparent way of incorporating these QueryParameters. But QueryParameters are a powerful tool for interacting with user requests since they can copy the URL and maintain the filters.
Motivation
Within my attempts to create a clean API on top of Vapor I found that query parameters are not to be ignored. I tried to create something transparent that wouldn't need my attention for converting QueryParameters to the filter object I wanted. Most people have different goals for using QueryParameters for a filter. Some use it for paginations, others for database interactions. User filtering, API calls.. etc.
Proposed solution
I propose creating a protocol that allows a struct or class complying to this protocol to be initializable with the QueryParameters. Similar to the RequestInitializable solution for Requests.
Code snippets
Note: Oriented towards MongoDB
protocol APIModel {
    associatedtype Identifier
    associatedtype Filter: QueryParameterInitializable

    static func resolve(identifier: Identifier) throws -> Self?
    static func discover(constraints: Filter) throws -> [Self]?
}

struct UserFilter: QueryParameterInitializable, MongoKitten.QueryProtocol {
    let username: String? = nil
    let age: Int? = nil

    init(queryParameters: [String: String]) {
        self.username = queryParameters["username"]?.string
        self.age = queryParameters["age"]?.string
    }

    var data: Document {
        var doc: Document = [:]
        if let username = username {
            doc["username"] = ~username
        }
        ....
    }
}

extension User: APIModel {
    typealias Identifier = ObjectId
    typealias Filter = UserFilter

    static let collection: Collection = db["users"]

    static func discover(constraints: Filter) throws -> [User]? {
        return try collection.find(matching: contraints.data)
    }
}

Impact
There'll be zero impact on the Vapor codebase and zero impact on the existing applications build with Vapor.
Alternatives considered
The alternative is to implement this yourself in every Vapor application that uses this.

This is interesting. I think a good first step would be having RequestInitializable as a more well-defined and useful class.
It looks like what you are doing here would be similar to something like.
try User.query().filter(request).all()

It completely is equal to that


Should make a new release for distro packaging

Description
The version in many distros' package repo (Ubuntu, Arch, etc.) is still 7.1.0, which was released 2 years ago and contains some minor bugs that has long been fixed in master (like https://github.com/dylanaraps/neofetch/issues/1274).
Why is there no release after August 2020? Is there a plan for the next release?
Neofetch version: 7.1.0

This repo don't seem to be maintained anymore, maybe check out HyFetch

HyFetch is a fork of neofetch with LGBTQ pride flags, but the repo also maintains an updated version of the original neofetch, addressing many issues and pull requests.
Read the "Running Updated Original Neofetch" section for more info!

Related: https://github.com/hykilpikonna/hyfetch/issues/37


7TV Global Emote when trying to do simple smile

Checklist

[X] I'm reporting a problem with Chatterino
[X] I've verified that I'm running the most recent nightly build or stable release
[X] I've looked for my problem on the wiki
[X] I've searched the issues and pull requests for similar looking reports

Describe your issue
Normally I use the colon : key and then start typing an emote name on Twitch without issue. I also sometimes do the basic default emotes like :) or :(
I noticed recently that when doing :) or :( it pops up showing an emote with a name of (7TV) but I unknowingly hit enter to send the message. From what I see (7TV) is an alias of 7tvM however, I think the behaviour is a bit odd overall.
I don't know entirely the best solution but I feel like there should be an added mechanism where :) and :( don't resolve to an emote? Perhaps the pattern has to match something like ^(:\w) (starts with colon followed by any word character?
Screenshots

OS and Chatterino Version
Chatterino 7.4.4 (commit 90ee0afd) on Windows 10 Version 2009

uhh.. looks like it somehow fixed itself? Maybe my client was bugging?

Your global Twitch emotes probably just failed to load, if this ever happens again click the 🙂 and go to the Global tab and it will be very likely that no Twitch emotes will be available, which should be resolved by a restart of the application.
(I assume that's what you did after you opened this issue originally)

This isn't an issue with this fork. If this is still an issue, please open one upstream.


feat(settings): add github action

Add Github action.

@nguoianphu, hello, thanks for the PR. Can you check the action error?

@nguoianphu, The error was apparently due to the fact that the PR had not yet been merged. After merge everithing is working. Is it possible to trigger an action during realese (not push or PR)?


Update EndpointIn to allow arbitrary size writes

This updates the EndpointIn::write() API to support writes larger than the endpoint's maximum packet size.  A new EndpointInSinglePacket helper trait was added to support driver implementations that only allow writing a single packet at a time.  At the moment all of the provided drivers are still using this implementation, but they could be updated to write more data at once in the future.
This has not yet changed any code in embassy-usb to send larger packets.  I wasn't sure if it would be better to bump the
embassy-usb-driver version number before doing that, since this is a meaningful change, and we would want to ensure
that larger-sized writes aren't sent to older driver implementations that do not support this.

One caveat here: I haven't tested the embassy-stm32, embassy-nrf, or embassy-rp implementations on actual hardware.  That said, the unit test should hopefully provide some confidence that it works correctly.
I also have a corresponding change almost ready for the read() APIs, but figured I would send the write() change out for comments first.
One possible concern about this API change: if a write() or read() operation is dropped (say, if it was abandoned because of a timeout), the caller can no longer really reason about how much data may have been sent or received before the operation was dropped.  Unless this is an isochronous endpoint, the user would presumably need to reset the bus after a dropped operation to get back to a known state.  I'm not sure if people feel like this problem matters in practice, and if callers would want to attempt to resume using an endpoint without resetting it even after a timeout.  Even today, it feels somewhat burdensome to require that usb driver implementations guarantee no data loss after a dropped read(): it means that driver implementations must always have enough buffer space of their own to store read data between a dropped read() and the next time the user calls read() to get this data.  This just happens to be more feasible to do today with at most 1 packet outstanding, and harder if the read could be many packets long.

Since this is a breaking change to embassy-usb-driver which is somewhat disruptive, i'd prefer to wait until at least one in-tree driver implements the write() API (and ideally demonstrates a perf improvement as a result). Otherwise if we merge this now we're taking the downside of the break with no upside.

Sure, that makes sense.  I'm happy to contribute an implementation for embassy-stm32 and wait before that is done for this to go in.  I did just get a black pill board and have that working now, so I can do some testing on stm32.  I have code for esp32 that supports streaming transfers, and I should be able to port that over.

This update incorporates some of the review feedback:

I renamed write_one_packet() to write_packet()
To mitigate some of the breaking changes in the embassy-usb-driver API, I left the write() API the same, and added this new behavior as a separate write_data() API.  (write() now has a default implementation that calls write_data(), so it supports larger writes, but any existing code that calls it with a single packet at a time should still behave exactly the same.)  That said, this is still a breaking change for embassy-usb-driver implementations (since they now have to implement write_data()), but it avoids breaking the API for users of the API in embassy_usb
The new write_data() API accepts the data, plus a force_short_packet parameter to indicate if the caller wishes the implementation to send a zero-length packet at the end of the transfer if the data is a multiple of the max packet size.

I also have an implementation for embassy-stm32 mostly ready, over here: https://github.com/simpkins/embassy/commit/867c7c1908caecda6913015c4b6eba172b15aed7
However, I've only done pretty cursory testing of it so far (I mainly just hacked up one of the usb_serial examples to always send back large chunks of data on any input, rather than echoing the input data).

the caller can no longer really reason about how much data may have been sent or received before the operation was dropped

Can the method just return a count of the sent packets or bytes?
Is EndpointError::BufferOverflow still needed after this PR?

Can the method just return a count of the sent packets or bytes?

No, unfortunately it can't: if the operation is dropped there is no opportunity to return anything at all.

Is EndpointError::BufferOverflow still needed after this PR?

It is still needed in the receive case.  Even if we update the read APIs to allow reading more than a single packet worth of data at once, if the caller provides a buffer whose length is not a multiple of the max packet size, we can encounter a BufferOverflow situation if the final packet contains more data than the caller expected.

marking as draft until these concerns are solved.


Update docker load security docs

Previous comment was added in docker v1.5 and the original issues it is referring to do not apply anymore.
fixes #24779
@aaronlehmann

LGTM
May want to add something about knowing source of a docker load file, but this is fine.

LGTM, thanks!

I saw this doc saying that "limiting the possibility of an attacker causing a collision with an existing image". Do you mean that "docker load" now won't replace existing image with a same tag name in the tar file (generated by "docker save") ?
As far as I know, one can tag a centos image with the name, for instance "ubuntu:14.04". And docker save it to a tar file. Then if another host "docker load" this tar file, this command would force to replace existing ubuntu:14.04. How can I avoid this?  Add an option "--override" to "docker load" and make it won't replace existing image others are using by default seems more reasonable to me.  Thoughts?
Please correct me if I missed something important.

@tangzhankun This addition has nothing to do with naming. This is about ensuring that layers cannot be replaced by with different content. docker load behavior for naming should be unaffected.

@stevvooe , Thanks for the explanation. I guess I need to raise an issue for the behavior changes of "docker load". I think it should add option to let the user choose whether to replace existing same tag name image.


Service contracts functionaity in Rust client

Is your feature request related to a problem? Please describe
I am trying to use service contracts functionality (get, accept, reject, set-fees and set-metadata) for the standalone Gateway but there is no way to do it from the tfchain Rust client.
Describe the solution you'd like
To be able to use from Rust client.

@AbdelrahmanElawady Is this still relevant after azmy suggestion?

nope, not anymore. We will use subxt and the scale file withing the gateway itself.


What happened to Server.tasks

tasks used to be availble for a Server object. Calling methods from Server.tasks such as Server.tasks.run still works. I can't find this on the API documentation. Does anyone know if tasks has been deprecated or replaced?
Edit: I found the Tasks class in the source. Where is the documentation for the Tasks class?

@craigk-from-vanguard thanks for raising this - it looks like we do have a pending PR #525 to add documentation around Tasks. I'll work on getting that finished out.

@craigk-from-vanguard I've finished up that PR with the docs, so the Tasks docs are now live:
https://tableau.github.io/server-client-python/docs/api-ref#tasks

@bcantoni Thank you so much!


modules_to_save Incorrect Overlap in Multiple LoRA Adapters

System Info
Python 3.11.9
transformers==4.40.2
peft==0.11.2
Who can help?
@BenjaminBossan
A bug occurs in the PEFT library when using multiple LoRA adapters, each with a unique modules_to_save configuration. The issue arises when the modules_to_save from the first LoRA adapter (e.g., adapter_1) is applied to subsequent adapters (e.g., adapter_2), rather than maintaining independent configurations. As a result, modules specified in modules_to_save for adapter_1 also appear in adapter_2, leading to unintended behavior and possibly affecting fine-tuning accuracy. This incorrect handling of modules_to_save causes duplicate entries where only the respective LoRA adapter’s modules should be saved.
Information

[X] The official example scripts
[ ] My own modified scripts

Tasks

[X] An officially supported task in the examples folder
[ ] My own task or dataset (give details below)

Reproduction
The following example code demonstrates this issue, displaying the model structure where adapter_2 contains modules meant only for adapter_1.
Example Code
import os
from transformers import AutoModelForCausalLM
from peft import LoraConfig, get_peft_model, PeftModel

# Get the directory of the current Python script
script_dir = os.path.dirname(os.path.abspath(__file__))

# Define relative paths for adapters
adapter_1_path = os.path.join(script_dir, "adapter_1")
adapter_2_path = os.path.join(script_dir, "adapter_2")

# Load base model
base_model = AutoModelForCausalLM.from_pretrained("gpt2")

# Define LoRA configs with different modules_to_save
lora_config_1 = LoraConfig(
    r=8,
    lora_alpha=32,
    target_modules=["c_attn"],
    lora_dropout=0.05,
    bias="none",
    task_type="CAUSAL_LM",
    modules_to_save=["lm_head"]
)

lora_config_2 = LoraConfig(
    r=8,
    lora_alpha=32,
    target_modules=["c_proj"],
    lora_dropout=0.05,
    bias="none",
    task_type="CAUSAL_LM",
    modules_to_save=["wte"]
)

# Apply and save the first adapter
os.makedirs(adapter_1_path, exist_ok=True)
model_with_lora_1 = get_peft_model(base_model, lora_config_1, adapter_name="adapter_1")
model_with_lora_1.save_pretrained(adapter_1_path)

# Apply and save the second adapter
os.makedirs(adapter_2_path, exist_ok=True)
model_with_lora_2 = get_peft_model(base_model, lora_config_2, adapter_name="adapter_2")
model_with_lora_2.save_pretrained(adapter_2_path)

# Load a fresh base model and wrap it in PeftModel by loading the first adapter
base_model = AutoModelForCausalLM.from_pretrained("gpt2")
peft_model = PeftModel.from_pretrained(base_model, os.path.join(adapter_1_path, "adapter_1"), adapter_name="adapter_1")

# Load the second adapter into the PeftModel
peft_model.load_adapter(os.path.join(adapter_2_path, "adapter_2"), adapter_name="adapter_2")

# Display structure and inspect unexpected 'modules_to_save' overlap
print("Expected `modules_to_save` for each adapter:")
print("Adapter 1 `modules_to_save`: ['lm_head']")
print("Adapter 2 `modules_to_save`: ['wte']")
print("\nActual model structure and `modules_to_save` contents:\n")
print(peft_model.transformer.wte)
print(peft_model.lm_head)

The code output will be:
Expected `modules_to_save` for each adapter:
Adapter 1 `modules_to_save`: ['lm_head']
Adapter 2 `modules_to_save`: ['wte']

Actual model structure and `modules_to_save` contents:

ModulesToSaveWrapper(
  (original_module): Embedding(50257, 768)
  (modules_to_save): ModuleDict(
    (adapter_2): Embedding(50257, 768)
  )
)
ModulesToSaveWrapper(
  (original_module): Linear(in_features=768, out_features=50257, bias=False)
  (modules_to_save): ModuleDict(
    (adapter_1): Linear(in_features=768, out_features=50257, bias=False)
    (adapter_2): Linear(in_features=768, out_features=50257, bias=False)
  )
)

Expected behavior
As you see adapter 2 is also built for the "lm_head" module to which it shouldn't, the expected output is shown below:
Expected `modules_to_save` for each adapter:
Adapter 1 `modules_to_save`: ['lm_head']
Adapter 2 `modules_to_save`: ['wte']

Actual model structure and `modules_to_save` contents:

ModulesToSaveWrapper(
  (original_module): Embedding(50257, 768)
  (modules_to_save): ModuleDict(
    (adapter_2): Embedding(50257, 768)
  )
)
ModulesToSaveWrapper(
  (original_module): Linear(in_features=768, out_features=50257, bias=False)
  (modules_to_save): ModuleDict(
    (adapter_1): Linear(in_features=768, out_features=50257, bias=False)
  )
)

Thanks a lot for reporting this. Indeed, the handling of modules_to_save can be messy at times and the outcome you show should be avoided. I don't have the opportunity to test this right now, but my assumption is that this extra module won't disrupt the results for adapter 2 because it is a copy of the original layer and behaves exactly the same, as that right?

No worries, glad to be of any help. As far as I have tested it should be fine and using the correct loaded layer, the only problem is redundancy in loaded modules. I also dug a bit deeper and noticed that the problem originates from this function:
https://github.com/huggingface/peft/blob/162d7e57ee0088f42eb0f26150bd9170d30f3637/src/peft/peft_model.py#L966
For an unknown reason when using load_adapter: https://github.com/huggingface/peft/blob/162d7e57ee0088f42eb0f26150bd9170d30f3637/src/peft/peft_model.py#L969
The set is not being updated to only the new layer and it will still hold the old layer in the set too (which shouldn't). For example if I manually hack the above script the problem will be solved:
...

# Apply and save the second adapter
os.makedirs(adapter_2_path, exist_ok=True)
model_with_lora_2 = get_peft_model(base_model, lora_config_2, adapter_name="adapter_2")
model_with_lora_2.save_pretrained(adapter_2_path)

# Load a fresh base model and wrap it in PeftModel by loading the first adapter
base_model = AutoModelForCausalLM.from_pretrained("gpt2")
peft_model = PeftModel.from_pretrained(base_model, os.path.join(adapter_1_path, "adapter_1"), adapter_name="adapter_1")

peft_model.modules_to_save = {"wte"} # <----------- HERE manually changing the modules_to_save
# Load the second adapter into the PeftModel
peft_model.load_adapter(os.path.join(adapter_2_path, "adapter_2"), adapter_name="adapter_2")

...

Okay, I managed to reproduce the error. My tentative fix is in #2220. Right now, there is a CI issue but it should hopefully resolve itself soon. Meanwhile, it would be great if you could check if the fix makes sense to you.
Just a side note, when adding multiple adapters, don't use get_peft_model twice, use peft_model.add_adapter instead. But even with that change, the problem is reproducible.

@BenjaminBossan sorry, I forgot to check this one. However, I just checked it after your message with a fresh installation of peft from your drafted pull requests and the problem I had earlier do not appear anymore! Thank you for fixing this one.
ModulesToSaveWrapper(
  (original_module): Embedding(50257, 768)
  (modules_to_save): ModuleDict(
    (adapter_2): Embedding(50257, 768)
  )
)
ModulesToSaveWrapper(
  (original_module): Linear(in_features=768, out_features=50257, bias=False)
  (modules_to_save): ModuleDict(
    (adapter_1): Linear(in_features=768, out_features=50257, bias=False)
  )
)


Missing addition of break in convert empty if-case to switch statement

Following from https://github.com/dart-lang/sdk/issues/56371.
If we have the following switch:
switch (v) {
  case 5:
    break;
  case 6:
    0;
    break;
  default:
    1;
}

Turns into:
if (v case 5) {
} else if (v case 6) {
  0;
} else {
  1;
}

If we turn it back, it should add the break at the case 5, but it doesn't.
This is the current output:
switch (v) {
  case 5:      // Missing `break;`
  case 6:
    0;
  default:
    1;
}

I can reproduce this problem and am currently working on a fix.

https://dart-review.googlesource.com/c/sdk/+/384306


csdid2 not running

Hi! I want to use the new mata version of csdid, however I'm getting the following error:
frause mpdta, clear
csdid2 lemp, ivar(countyreal) tvar(year) gvar(first)
Producing Long Gaps by default
Using method reg
                 <istmt>:  3499  csdid() not found
r(3499);

I'm wondering if this perhaps a bug related to the new csdid script. Using tracing, I find that the following error:
    ------------------------------------------------------------- end _xtreg_chk_cl2 ---
  - }
  - if "`cluster'"!="" {
  = if ""!="" {
    if "`ivar'"!="" _xtreg_chk_cl2 `cluster' `ivar' `touse'
    }
  - if "`ivar'"!="" {
  = if "countyreal"!="" {
  - mata:balance("`ivar'","`tvar'","`touse'")
  = mata:balance("countyreal","year","__000002")
  - }
  - local cvar `cluster'
  = local cvar
  - mata:`csname'=csdid()
  = mata:csdid=csdid()
                 <istmt>:  3499  csdid() not found
  --------------------------------------------------------------- end csdid2.csdid_r ---
------------------------------------------------------------------------- end csdid2 ---
r(3499);

Stata version: 17 MP 2-core
OS: MacOS 12.5
M1 structure

Did you check on installing the full csdid2? (fra install)
there are some mata libraries that also need to be on your computer, without them, you can run the command

perhaps best method
net install csdid2, from("
https://raw.githubusercontent.com/friosavila/stpackages/main") replace
That should work.
F
On Wed, May 8, 2024 at 8:28 AM Arminos21 @.***> wrote:

Hi Fernando,
I am also running into similar problems. Could you please provide a short
installation guide? :)
Best regards
—
Reply to this email directly, view it on GitHub
https://github.com/friosavila/stpackages/issues/6#issuecomment-2100465999,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ASZKKFVZIBVZ2P7DUC7PKBDZBIK5ZAVCNFSM6AAAAABEF73HRKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBQGQ3DKOJZHE
.
You are receiving this because you commented.Message ID:
@.***>


can't deploy my app with the aws-amplify console

i suddenly start getting this error in the build stage, after cloning

can't figure out how to fix this

Can you give us more info about your apps. Such as app arn(which can be found on app settings) and the region?

i succeeded in deploying by removing the backend environment
not sure about its purpose when deploying using github webhook
the console force you to choose or create a backend but i think its not configured.
hope this might help others =)


VSCode reopening error on every time launch

VSCode Version: 1.29
OS Version: macOS Mojave 10.14.1

Steps to Reproduce:

I was using VSCode for several months now. And for some reason I happen to do something on the terminal I am not sure to remember.

But since then I am getting this error message repeatedly.

Tried steps mentioned here or even from uninstall and install from HomeBrew.

Doesnt seems to work. It just opens and immediately closes with this error message.
Does this issue occur when all extensions are disabled?: Yes
I really dont want and wont want to switch other editors. VSCode typescript integration is blazing fast and want to continue use it. Any help is appreciated.

@AyanGhatak does this happen when you run Code from the terminal or from the dock as well?

Hi @bpasero It was caused in all possible situations.
Seems to be caused due to this . - https://github.com/Microsoft/vscode/issues/60526
Reinstalling and updating Cylance seems to solve the issue.
Thank you. :) It seems so good to be back on VSCode. Had a very painful 4-5 days to code in Typescript without VSCode. 😛
Closing the ticket.


Can't get formatting to work

I'm on Ubutun 15.
I have clang-format version 3.4.2 installed
I have VSCode 1.3.1
I have added the following to my vscode settings.json file:
"clang-format.language.cpp.enable": true,
"clang-format.language.c.enable": true,
"clang-format.language.c.style": "LLVM",
"clang-format.language.cpp.style": "LLVM",
"clang-format.language.c.fallbackStyle": "LLVM",
"clang-format.language.c.fallbackStyle": "LLVM"
I try to run the "editor.action.format" command which appears to be bound to ctrl+shift+i and I get nothing.
What am I missing or doing wrong?

Update:
If I run the format command by entering the command pallete ctrl+shift+p and select "Format Code" I get the following error: "Cannot format due to syntax errors"
This occurs with the simplest of code:
int main(int argc, char** argv)
{
return 0;
}

The syntax error is not in your code. Actually, clang-format does not support --fallback-style="LLVM" before version 3.6.0. Since the --fallback-style option currently always gets passed to clang-format, you need at least clang-format 3.6.0 to use this extension.

That works thanks.


Bug: 404 on Hooks example Mongose

https://docs.feathersjs.com/hooks/examples.html#validation - 404 from - https://docs.feathersjs.com/databases/mongoose.html in text link called "using hooks"

Thanks. I removed it since that isn't really relevant anyway. Updated docs for the next release will also come with https://github.com/feathersjs/feathers-docs/pull/299.


infra: vr healthcheck and other fixes

Fixes #362

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build primate packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark:centos :heavy_check_mark:debian :heavy_check_mark:archive.
QA: http://primate-qa.cloudstack.cloud:8080/client/pr/428 (JID-2033)

@shwstppr can you merge the conflict and use  the new nics component from master instead?

@rhtyd Done. Old nics view was much better,

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build primate packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark:centos :heavy_check_mark:debian :heavy_check_mark:archive.
QA: http://primate-qa.cloudstack.cloud:8080/client/pr/428 (JID-2072)

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build primate packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark:centos :heavy_check_mark:debian :heavy_check_mark:archive.
QA: http://primate-qa.cloudstack.cloud:8080/client/pr/428 (JID-2073)

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build primate packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark:centos :heavy_check_mark:debian :heavy_check_mark:archive.
QA: http://primate-qa.cloudstack.cloud:8080/client/pr/428 (JID-2074)

@blueorangutan package

@rhtyd a Jenkins job has been kicked to build primate packages. I'll keep you posted as I make progress.

@rhtyd a Jenkins job has been kicked to build primate packages. I'll keep you posted as I make progress.

@rhtyd a Jenkins job has been kicked to build primate packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark:centos :heavy_check_mark:debian :heavy_check_mark:archive.
QA: http://primate-qa.cloudstack.cloud:8080/client/pr/428 (JID-2093)

@blueorangutan package

@rhtyd a Jenkins job has been kicked to build primate packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark:centos :heavy_check_mark:debian :heavy_check_mark:archive.
QA: http://primate-qa.cloudstack.cloud:8080/client/pr/428 (JID-2109)

Basic tests performed, LGTM.


remove inst_autoimage client (bsc#1184537)

require S/390-specific package (bsc#1183789)

Note for the pull request authors:
The master branch is not in use. Please, make your PR against SLE-15-SP2
branch if you are sending changes for SUSE MicroOS.

Note on the branch name: I decoupled it form SLES versioning, since there are expected two released based on 15-SP3

Yes, it is the starting point for SLE Micro 5.1.


Fix link to AWS Resources in README.md

Issue #, if available:
Description of changes:
update resource link in README.md since it has moved to opentelemetry-java-contrib repository
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

bumping this

Thanks for the PR


CB-13052 null pointer check for network validation if network not ava…

…ilable
See detailed description in the commit message.

Having deja vu: looks like this potential NPE was already mentioned here 😄

Follow-up to #10939

UT is coming with a next PR


Realsense R200 on raspberry pi2

SUMMARY
PARAMETERS

/camera/camera_nodelet_manager/num_worker_threads: 4
/camera/depth_rectify_depth/interpolation: 0
/camera/disparity_depth/max_range: 4.0
/camera/disparity_depth/min_range: 0.5
/camera/disparity_registered_sw/max_range: 4.0
/camera/disparity_registered_sw/min_range: 0.5
/camera/driver/base_frame_id: camera_link
/camera/driver/camera_type: R200
/camera/driver/color_fps: 30
/camera/driver/color_frame_id: camera_rgb_frame
/camera/driver/color_height: 480
/camera/driver/color_optical_frame_id: camera_rgb_optica...
/camera/driver/color_width: 640
/camera/driver/depth_fps: 30
/camera/driver/depth_frame_id: camera_depth_frame
/camera/driver/depth_height: 360
/camera/driver/depth_optical_frame_id: camera_depth_opti...
/camera/driver/depth_width: 480
/camera/driver/enable_color: True
/camera/driver/enable_depth: True
/camera/driver/enable_fisheye: False
/camera/driver/enable_imu: False
/camera/driver/enable_ir2: True
/camera/driver/enable_ir: True
/camera/driver/enable_pointcloud: False
/camera/driver/enable_tf: True
/camera/driver/ir2_frame_id: camera_ir2_frame
/camera/driver/ir_frame_id: camera_ir_frame
/camera/driver/mode: manual
/camera/driver/serial_no:
/camera/driver/usb_port_id:
/camera/points_xyzrgb_sw_registered/queue_size: 100
/rosdistro: kinetic
/rosversion: 1.12.7

NODES
/camera/
camera_nodelet_manager (nodelet/nodelet)
depth_metric (nodelet/nodelet)
depth_metric_rect (nodelet/nodelet)
depth_points (nodelet/nodelet)
depth_rectify_depth (nodelet/nodelet)
depth_registered_sw_metric_rect (nodelet/nodelet)
disparity_depth (nodelet/nodelet)
disparity_registered_sw (nodelet/nodelet)
driver (nodelet/nodelet)
ir_rectify_ir (nodelet/nodelet)
points_xyzrgb_sw_registered (nodelet/nodelet)
register_depth_rgb (nodelet/nodelet)
rgb_debayer (nodelet/nodelet)
rgb_rectify_color (nodelet/nodelet)
rgb_rectify_mono (nodelet/nodelet)
ROS_MASTER_URI=http://localhost:11311
core service [/rosout] found
process[camera/camera_nodelet_manager-1]: started with pid [1965]
process[camera/driver-2]: started with pid [1966]
process[camera/rgb_debayer-3]: started with pid [1967]
process[camera/rgb_rectify_mono-4]: started with pid [1969]
process[camera/rgb_rectify_color-5]: started with pid [1980]
process[camera/ir_rectify_ir-6]: started with pid [1989]
process[camera/depth_rectify_depth-7]: started with pid [2003]
process[camera/depth_metric_rect-8]: started with pid [2011]
process[camera/depth_metric-9]: started with pid [2019]
process[camera/depth_points-10]: started with pid [2029]
process[camera/register_depth_rgb-11]: started with pid [2037]
process[camera/points_xyzrgb_sw_registered-12]: started with pid [2053]
process[camera/depth_registered_sw_metric_rect-13]: started with pid [2066]
process[camera/disparity_depth-14]: started with pid [2082]
process[camera/disparity_registered_sw-15]: started with pid [2096]
[ INFO] [1511980703.632140936]: Initializing nodelet with 4 worker threads.
[ERROR] [1511980708.623243341]: /camera/driver - No cameras detected!
[ERROR] [1511980708.624803183]: /camera/driver - Error calling rs_create_context ( api_version:11201 ):
uvcvideo kernel module is not loaded
[FATAL] [1511980709.033301286]: Failed to load nodelet '/camera/ir_rectify_ir` o
This is the error that i get. Is there anyway around it? Raspberrypi2 has only USB 2.0 . Does the Realsense R200 require USB 3.0 to work?

Hello @Dhivin, RealSense R200 camera supports only USB3 interface.


[servus] extractor reimplementation due to new url schema

Please follow the guide below

You will be asked some questions, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your pull request (like that [x])
Use Preview tab to see how your pull request will actually look like

Before submitting a pull request make sure you have:

[x] At least skimmed through contributing guidelines including yt-dlp coding conventions
[x] Searched the bugtracker for similar pull requests
[x] Checked the code with flake8

In order to be accepted and merged into yt-dlp each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[x] I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[ ] Bug fix
[ ] Improvement
[x] New extractor
[ ] New feature

Description of your pull request and other information
Closes #1076
Current servustv.com platform seems to have an API which is easy to implement.
Since I don't know the old one I left the ServusIE class untouched.
Open questions:

video and audio streams are separated - can we provide a default merge?

can we provide a default merge?

wdym? We already merge the best video and audio together assuming ffmpeg is available

can we provide a default merge?

wdym? We already merge the best video and audio together assuming ffmpeg is available

Just realized it myself. Very smart! But for the test I had to specify a format, otherwise it says 'url field is missing' which made me puzzled.

for the test, specify bestvideo as format

Another thing. The JSON API requires a timezone in the query. Something like Europe/Berlin.  It also seems to work with invalid stuff line XX. You guys have any experience with that?

Only site that I know needs it is tiktok. There, we have just hardcoded it to New York. Assuming it doesn't actually affect the extraction, ig you can similarly hardcode any timezone

implemented as separate plugin

Making me review the PR and then closing it is not appreciated. If you don't intend to address reviews, don't make a PR in the first place

implemented as separate plugin

Hello flashdagger, I feel disappointed, that you've decided to fork this project and implement a solution for yourself instead of contributing here with your knowledge. A couple of people are waiting for a solution and it is no good idea to install a separate tool or plugin for each website. I would appreciate if you could adapt your solution according pukkandan recommendations to make yt-dlp better and better.

implemented as separate plugin

Hello flashdagger, I feel disappointed, that you've decided to fork this project and implement a solution for yourself instead of contributing here with your knowledge. A couple of people are waiting for a solution and it is no good idea to install a separate tool or plugin for each website. I would appreciate if you could adapt your solution according pukkandan's recommendations to make yt-dlp better and better.

A plugin is not a fork. You just extend the official yt-dlp installation with additional extractors and still benefit from all improvements of the core library. That way other developers can provide extractors which the yt-dlp team doesn't have to maintain.

@flashdagger: You seem to have a working extractor for servustv.com. Could you offer your code to the yt-dlp team?

@flashdagger: You seem to have a working extractor for servustv.com. Would you be willing to share your code with the yt-dlp team?

Sure. It's Unlicense anyway.

ok, sry I wasn't clear, I meant giving pukkandan a link to your code.


The Folding For Nested Brackets Is Not Done Correctly

Issue Type: Bug
We have lisp code with typical nested brackets structure, e.g.
(defun a ( b  c )
(defun d ( e  f )
(if (not g)
(progn)
)
; ** some comment ...  in lisp ";" is used for comment quote, and this cause the folding not work properly
)
)
when I try to collapse the range of (), it does not collapse the right range with the corresponding closing bracket.
VS Code version: Code 1.35.0 (553cfb2c2205db5f15f3ee8395bbd5cf066d357d, 2019-06-04T01:17:12.481Z)
OS version: Windows_NT x64 10.0.16299

System Info

Item
Value

CPUs
Intel(R) Xeon(R) Gold 5118 CPU @ 2.30GHz (48 x 2295)

GPU Status
2d_canvas: enabledchecker_imaging: disabled_offflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onnative_gpu_memory_buffers: disabled_softwarerasterization: enabledsurface_synchronization: enabled_onvideo_decode: enabledwebgl: enabledwebgl2: enabled

Load (avg)
undefined

Memory (System)
63.63GB (50.70GB free)

Process Argv

Screen Reader
no

VM
0%

Extensions (1)

Extension
Author (truncated)
Version

autolispext
Aut
1.5.5

Anything smarter than indent-based folding is the responsibility of the extension that implements the language you're coding in. See here for doc. Please raise this as an issue with the developer of the Lisp extension you are using, and close this issue here because it's not a VSCode bug.

@gjsjohnmurray is correct, thanks, John, for explaining.


[fix] Require PIN when exiting baking app

A security regression was outlined by users of the baking app in the recent release, stating that when exiting the app the device's PIN was not requested, feature that is present in older versions of the app.
This PR aims to fix this regression by invalidating the pin using the function provided by the SDK to do so.

Tested locally. This patch behaves as expected.


/object/$userid/property/ vs /object/$userid/property

Hey, so I was testing out my rules on the simulator when I came across an error when I tried to write to the root. Turns out the rule /object/$userid/property/ was being enforced on the root, I removed the trailing slash and it removed it from the root. Not sure why that happened but it's a pretty weird bug that needs to be squashed...

I think I just fixed this today - see issue 66.
On Fri, Oct 30, 2015, 7:08 PM Kerman<EMAIL_ADDRESS>wrote:

Hey, so I was testing out my rules on the simulator when I came across an
error when I tried to write to the root. Turns out the rule
/object/$userid/property/ was being enforced on the root, I removed the
trailing slash and it removed it from the root. Not sure why that happened
but it's a pretty weird bug that needs to be squashed...
—
Reply to this email directly or view it on GitHub
https://github.com/firebase/bolt/issues/71.


GpuLaunchKernel errors with Internal: invalid device function

System information

Windows 10
TensorFlow GPU installed from PIP installer:
TensorFlow version: 2.0.0
Python version:  3.7.4
CUDA/cuDNN version: 10.1
GPU model and memory: Geforce GTX 1050 4GB

Describe the current behavior
I'm trying to run a facial recognition project and the message bellow appears
Using TensorFlow backend.
2019-10-24 14:32:44.154323: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
2019-10-24 14:32:51.960166: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library nvcuda.dll
2019-10-24 14:32:52.321115: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
name: GeForce GTX 1050 major: 6 minor: 1 memoryClockRate(GHz): 1.493
pciBusID: 0000:01:00.0
2019-10-24 14:32:52.325985: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2019-10-24 14:32:52.331740: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0
2019-10-24 14:32:52.335877: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2019-10-24 14:32:52.342803: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
name: GeForce GTX 1050 major: 6 minor: 1 memoryClockRate(GHz): 1.493
pciBusID: 0000:01:00.0
2019-10-24 14:32:52.346290: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2019-10-24 14:32:52.350583: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0
2019-10-24 14:32:52.458458: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1159] Device interconnect StreamExecutor with strength 1 edge matrix:
2019-10-24 14:32:52.461435: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1165]      0
2019-10-24 14:32:52.462925: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 0:   N
2019-10-24 14:32:52.467353: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3083 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1050, pci bus id: 0000:01:00.0, compute capability: 6.1)
2019-10-24 14:32:52.647343: F .\tensorflow/core/kernels/random_op_gpu.h:227] Non-OK-status: GpuLaunchKernel(FillPhiloxRandomKernelLaunch<Distribution>, num_blocks, block_size, 0, d.stream(), gen, data, size, dist) status: Internal: invalid device function

Can you please provide the sequence of steps or a minimal code to reproduce this issue. Thanks!

I trying to run this projetct
https://github.com/yu4u/age-gender-estimation.git

an you please try running the project on google colab and if see if you are encountering the same issue. Thanks!

Here it goes
Using TensorFlow backend.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:66: The name tf.get_default_graph is deprecated. Please use tf.compat.v1.get_default_graph instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:66: The name tf.get_default_graph is deprecated. Please use tf.compat.v1.get_default_graph instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:541: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:541: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:4479: The name tf.truncated_normal is deprecated. Please use tf.random.truncated_normal instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:4479: The name tf.truncated_normal is deprecated. Please use tf.random.truncated_normal instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:190: The name tf.get_default_session is deprecated. Please use tf.compat.v1.get_default_session instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:190: The name tf.get_default_session is deprecated. Please use tf.compat.v1.get_default_session instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:197: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:197: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:203: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:203: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead.
2019-10-24 20:30:03.809026: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency:<PHONE_NUMBER> Hz
2019-10-24 20:30:03.809331: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3c901c0 initialized for platform Host (this does not guarantee that XLA will be used). Devices:
2019-10-24 20:30:03.809372: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (0): Host, Default Version
2019-10-24 20:30:03.814851: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1
2019-10-24 20:30:03.952342: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2019-10-24 20:30:03.953224: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3c90380 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices:
2019-10-24 20:30:03.953256: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (0): Tesla K80, Compute Capability 3.7
2019-10-24 20:30:03.954473: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2019-10-24 20:30:03.955200: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
name: Tesla K80 major: 3 minor: 7 memoryClockRate(GHz): 0.8235
pciBusID: 0000:00:04.0
2019-10-24 20:30:03.962065: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.0
2019-10-24 20:30:03.962146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10.0
2019-10-24 20:30:04.052434: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10.0
2019-10-24 20:30:04.052667: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10.0
2019-10-24 20:30:04.052740: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10.0
2019-10-24 20:30:04.174903: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10.0
2019-10-24 20:30:04.175034: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7
2019-10-24 20:30:04.175183: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2019-10-24 20:30:04.175967: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2019-10-24 20:30:04.176739: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0
2019-10-24 20:30:04.180762: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.0
2019-10-24 20:30:04.182365: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1159] Device interconnect StreamExecutor with strength 1 edge matrix:
2019-10-24 20:30:04.182402: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1165]      0
2019-10-24 20:30:04.182418: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 0:   N
2019-10-24 20:30:04.183538: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2019-10-24 20:30:04.184299: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:983] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2019-10-24 20:30:04.185021: W tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:39] Overriding allow_growth setting because the TF_FORCE_GPU_ALLOW_GROWTH environment variable is set. Original config value was 0.
2019-10-24 20:30:04.185076: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10805 MB memory) -> physical GPU (device: 0, name: Tesla K80, pci bus id: 0000:00:04.0, compute capability: 3.7)
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:207: The name tf.global_variables is deprecated. Please use tf.compat.v1.global_variables instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:207: The name tf.global_variables is deprecated. Please use tf.compat.v1.global_variables instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:216: The name tf.is_variable_initialized is deprecated. Please use tf.compat.v1.is_variable_initialized instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:216: The name tf.is_variable_initialized is deprecated. Please use tf.compat.v1.is_variable_initialized instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:223: The name tf.variables_initializer is deprecated. Please use tf.compat.v1.variables_initializer instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:223: The name tf.variables_initializer is deprecated. Please use tf.compat.v1.variables_initializer instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:2041: The name tf.nn.fused_batch_norm is deprecated. Please use tf.compat.v1.nn.fused_batch_norm instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:2041: The name tf.nn.fused_batch_norm is deprecated. Please use tf.compat.v1.nn.fused_batch_norm instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:148: The name tf.placeholder_with_default is deprecated. Please use tf.compat.v1.placeholder_with_default instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:148: The name tf.placeholder_with_default is deprecated. Please use tf.compat.v1.placeholder_with_default instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:4271: The name tf.nn.avg_pool is deprecated. Please use tf.nn.avg_pool2d instead.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/keras/backend/tensorflow_backend.py:4271: The name tf.nn.avg_pool is deprecated. Please use tf.nn.avg_pool2d instead.
VIDEOIO ERROR: V4L: can't open camera by index 0
Traceback (most recent call last):
File "/content/age-gender-estimation/demo.py", line 138, in
main()
File "/content/age-gender-estimation/demo.py", line 99, in main
for img in image_generator:
File "/content/age-gender-estimation/demo.py", line 60, in yield_images
raise RuntimeError("Failed to capture image")
RuntimeError: Failed to capture image

Can you please share the github gist of the minimum reproducible example. Thanks!

Unfortunately, this is not possible because the project has interdependent files.

Replicates for me as well:

Windows 10
TensorFlow GPU installed from PIP installer:
TensorFlow version: 2.0.0 (v2.0.0-rc2-26-g64c3d382ca)
Python version: 3.7.3
CUDA/cuDNN version: 10.1
GPU model and memory: Geforce GTX 1080 6GB

Code:
from keras.datasets import mnist
from keras.models import Sequential
from keras.layers import Dense
from keras.utils import to_categorical

def network():
    model = Sequential()
    model.add(Dense(512, activation='relu', input_shape=((28*28),)))
    model.add(Dense(10, activation='softmax'))
    return model

def load_data():
    (training_images, training_labels), (test_images, test_labels) = mnist.load_data()

    training_images = training_images.reshape((60000, 28*28))
    training_images = training_images.astype('float32') / 255

    test_images = test_images.reshape((10000, 28 * 28))
    test_images = test_images.astype('float32') / 255

    training_labels = to_categorical(training_labels)
    test_labels = to_categorical(test_labels)

    return (training_images, training_labels), (test_images, test_labels)

def main():
    (training_images, training_labels), (test_images, test_labels) = load_data()
    network().compile(optimizer='rmsprop', loss='categorical_crossentropy', metrics=['accuracy'])
    network().fit(training_images, training_labels, batch_size=128, epochs=5)

if __name__ == '__main__':
    main()

Logs:
Using TensorFlow backend.
2019-10-27 17:20:13.357299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
2019-10-27 17:20:14.819311: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library nvcuda.dll
2019-10-27 17:20:14.898322: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.7335
pciBusID: 0000:03:00.0
2019-10-27 17:20:14.898509: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2019-10-27 17:20:14.899011: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0
2019-10-27 17:20:14.899295: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2019-10-27 17:20:14.902034: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.7335
pciBusID: 0000:03:00.0
2019-10-27 17:20:14.902229: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2019-10-27 17:20:14.902695: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0
2019-10-27 17:20:14.989517: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1159] Device interconnect StreamExecutor with strength 1 edge matrix:
2019-10-27 17:20:14.989658: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1165]      0
2019-10-27 17:20:14.989742: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 0:   N
2019-10-27 17:20:14.990395: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6430 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:03:00.0, compute capability: 6.1)
2019-10-27 17:20:15.255674: F .\tensorflow/core/kernels/random_op_gpu.h:227] Non-OK-status: GpuLaunchKernel(FillPhiloxRandomKernelLaunch, num_blocks, block_size, 0, d.stream(), gen, data, size, dist) status: Internal: invalid device function

I could reproduce the issue as well.
System information

Windows 10
TensorFlow GPU installed from PIP installer:
TensorFlow version: 2.0.0
Python version: 3.7.3
CUDA/cuDNN version: 10.1
GPU model and memory: Geforce GTX 1080 6GB

Code
from keras.models import Sequential
from keras.layers import Dense

model = Sequential()
print(1)
model.add(Dense(512, activation='relu', input_shape=((28 * 28),))) #crashes here
print(2) #not printed

Logs:
Using TensorFlow backend.
2019-10-27 18:19:50.390966: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
1
2019-10-27 18:19:51.450798: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library nvcuda.dll
2019-10-27 18:19:51.525684: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.7335
pciBusID: 0000:03:00.0
2019-10-27 18:19:51.525870: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2019-10-27 18:19:51.526328: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0
2019-10-27 18:19:51.526602: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2019-10-27 18:19:51.529355: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1618] Found device 0 with properties:
name: GeForce GTX 1080 major: 6 minor: 1 memoryClockRate(GHz): 1.7335
pciBusID: 0000:03:00.0
2019-10-27 18:19:51.529537: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.
2019-10-27 18:19:51.529999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1746] Adding visible gpu devices: 0
2019-10-27 18:19:51.617783: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1159] Device interconnect StreamExecutor with strength 1 edge matrix:
2019-10-27 18:19:51.617918: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1165]      0
2019-10-27 18:19:51.617997: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1178] 0:   N
2019-10-27 18:19:51.618650: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1304] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6430 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080, pci bus id: 0000:03:00.0, compute capability: 6.1)
2019-10-27 18:19:51.879458: F .\tensorflow/core/kernels/random_op_gpu.h:227] Non-OK-status: GpuLaunchKernel(FillPhiloxRandomKernelLaunch, num_blocks, block_size, 0, d.stream(), gen, data, size, dist) status: Internal: invalid device function

@s2pstefan, with you code, I had safe issue.

@s2pstefan I was not able to reproduce your error on colab. Heres my github gist.

Hi,
I see two issues with your test:

It does not use tensorflow-gpu
It does not run on Windows 10

I think this the error quite specific to this environment. Both @glaucimarfaleiro and myself were able to reproduce, given the correct setup.

I used tensorflow-gpu 2.0 but was not able to reproduce it. Heres ny github gist I think this issue is specific to windows.

Tensorflow should support windows.
From https://www.tensorflow.org/install:
TensorFlow is tested and supported on the following 64-bit systems: Ubuntu 16.04 or later, Windows 7 or later, macOS 10.12.6 (Sierra) or later (no GPU support), Raspbian 9.0 or later.
Not sure if you need more input from us, just let us know.

Good news, it seems that this has been fixed in the latest tf-nighlty-gpu. @glaucimarfaleiro , can you please confirm?

Good news, I tested again now and it seems that this issue has been fixed in the latest tf-nightly-gpu. @glaucimarfaleiro , can you please check as well?

@s2pstefan, it worked with tf-nightly-gpu. Thanks a lot.

I had this problem when compling TF 1.15.4 with --linkopt="/DEBUG:NONE" on windows


Touchbar support for macOS Sierra

macOS Sierra now has new APIs for global playback control for MacBook models with touchbar. Using them lets users control playback position and skip tracks from anywhere (effectively replacing the missing media keys). See GIF: https://cnet4.cbsistatic.com/img/UsolysTQYPgPtMiSWTK-Dc24JGY=/fit-in/370x0/2016/11/22/190aaf99-eda0-4624-9e7e-8f15aad7f088/scrub-itunes-touch-bar.gif
Having that support in Desktop Player would be great.

This should be tracked upstream with my PR's up there.
https://github.com/electron/electron/pull/8095

Umm, not really since you're not supposed to use the NSTouchBar API for that - but the new global multimedia API added in Sierra (similar to the iOS one), where you need to signal to the OS what you're playing and then handle multimedia events back.
The TouchBar APIs listed in the upstream won't work for that :/

Okay, totally didn't know that existed.  I'll raise an upstream issue for supporting that new API then :D

FYI I just got this working in Electron and I'll be raising a PR shortly 👍

Any news on the touchbar support? The screenshot looks amazing!

Pending an upstream PR https://github.com/electron/electron/pull/8280


How to build manifests manually ?

I've been trying to build manifests manually for Kepler for a few hours with no luck. I don't understand how to run build-manifest.sh ?
There is no build-manifest in the root of the project, while the Makefile is in the root of the project. Should I move build-manifest.sh from hack folder to the root of Kepler folder ?  I am a beginner with make.
The documentation is a bit broad about this, could you please explain how I can build the manifests manually ? I suspect that the helm installation is not working correctly, and I want to install Kepler manually.
If I move build-manifest.sh from hack folder and then run it through make build-manifest.sh , I get the following output :
fatal: not a git repository (or any of the parent directories): .git
fatal: not a git repository (or any of the parent directories): .git
make: command: Command not found
make: command: Command not found
mkdir -p bin
go: creating new go.mod: module tmp
Downloading<EMAIL_ADDRESS>can't load package: package<EMAIL_ADDRESS>can only use path@version syntax with 'go get'
make: *** [Makefile:241: kustomize] Error 1

please go to the Build manifests section here https://sustainable-computing.io/installation/kepler/

I followed that section but there is no build-manifest file in the root of kepler folder, they are all in hack folder, which folder I should run the make command in ?

In the top level of kepler (it does require go and kubectl though).

Or you can try the operator or helm chart deployments

@annis-souames I can build a manifests for you to try. What options do you need for the manifest, e.g. bare metal or VM? If on VMs, have you installed kernel headers on your env?

That would be so nice, I am using Google Kubernetes Engine so yes it's a VM, basically I am trying to monitor the energy consumption of this cluster on GKE and get the results on prometheus.

have you installed kernel headers on your env?

Yes, I updated the nodes of the cluster to use cgroups v2

apiVersion: v1
kind: Namespace
metadata:
  labels:
    sustainable-computing.io/app: kepler
  name: kepler
---
apiVersion: v1
kind: ServiceAccount
metadata:
  labels:
    sustainable-computing.io/app: kepler
  name: kepler-sa
  namespace: kepler
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
  labels:
    sustainable-computing.io/app: kepler
  name: kepler-clusterrole
rules:
- apiGroups:
  - ""
  resources:
  - nodes/metrics
  - nodes/proxy
  - nodes/stats
  verbs:
  - get
  - watch
  - list
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
  labels:
    sustainable-computing.io/app: kepler
  name: kepler-clusterrole-binding
roleRef:
  apiGroup: rbac.authorization.k8s.io
  kind: ClusterRole
  name: kepler-clusterrole
subjects:
- kind: ServiceAccount
  name: kepler-sa
  namespace: kepler
---
apiVersion: v1
data:
  BIND_ADDRESS: <IP_ADDRESS>:9102
  CGROUP_METRICS: '*'
  CPU_ARCH_OVERRIDE: ""
  ENABLE_EBPF_CGROUPID: "true"
  ENABLE_GPU: "true"
  ENABLE_PROCESS_METRICS: "false"
  EXPOSE_IRQ_COUNTER_METRICS: "true"
  EXPOSE_KUBELET_METRICS: "true"
  KEPLER_LOG_LEVEL: "1"
  KEPLER_NAMESPACE: kepler
  METRIC_PATH: /metrics
  MODEL_CONFIG: |
    CONTAINER_COMPONENTS_ESTIMATOR=false
    CONTAINER_COMPONENTS_INIT_URL=https://raw.githubusercontent.com/sustainable-computing-io/kepler-model-server/main/tests/test_models/DynComponentModelWeight/CgroupOnly/ScikitMixed/ScikitMixed.json
kind: ConfigMap
metadata:
  labels:
    sustainable-computing.io/app: kepler
  name: kepler-cfm
  namespace: kepler
---
apiVersion: v1
kind: Service
metadata:
  labels:
    app.kubernetes.io/component: exporter
    app.kubernetes.io/name: kepler-exporter
    sustainable-computing.io/app: kepler
  name: kepler-exporter
  namespace: kepler
spec:
  clusterIP: None
  ports:
  - name: http
    port: 9102
    targetPort: http
  selector:
    app.kubernetes.io/component: exporter
    app.kubernetes.io/name: kepler-exporter
    sustainable-computing.io/app: kepler
---
apiVersion: apps/v1
kind: DaemonSet
metadata:
  labels:
    sustainable-computing.io/app: kepler
  name: kepler-exporter
  namespace: kepler
spec:
  selector:
    matchLabels:
      app.kubernetes.io/component: exporter
      app.kubernetes.io/name: kepler-exporter
      sustainable-computing.io/app: kepler
  template:
    metadata:
      labels:
        app.kubernetes.io/component: exporter
        app.kubernetes.io/name: kepler-exporter
        sustainable-computing.io/app: kepler
    spec:
      containers:
      - args:
        - /usr/bin/kepler -v=1
        command:
        - /bin/sh
        - -c
        env:
        - name: NODE_NAME
          valueFrom:
            fieldRef:
              fieldPath: spec.nodeName
        image: quay.io/sustainable_computing_io/kepler:latest
        imagePullPolicy: Always
        livenessProbe:
          failureThreshold: 5
          httpGet:
            path: /healthz
            port: 9102
            scheme: HTTP
          initialDelaySeconds: 10
          periodSeconds: 60
          successThreshold: 1
          timeoutSeconds: 10
        name: kepler-exporter
        ports:
        - containerPort: 9102
          name: http
        resources:
          requests:
            cpu: 100m
            memory: 400Mi
        securityContext:
          privileged: true
        volumeMounts:
        - mountPath: /usr/src
          name: usr-src
        - mountPath: /lib/modules
          name: lib-modules
        - mountPath: /sys
          name: tracing
        - mountPath: /proc
          name: proc
        - mountPath: /etc/kepler/kepler.config
          name: cfm
          readOnly: true
      dnsPolicy: ClusterFirstWithHostNet
      serviceAccountName: kepler-sa
      tolerations:
      - effect: NoSchedule
        key: node-role.kubernetes.io/master
      volumes:
      - hostPath:
          path: /usr/src
          type: Directory
        name: usr-src
      - hostPath:
          path: /proc-host
          type: Directory
        name: proc
      - hostPath:
          path: /lib/modules
          type: Directory
        name: lib-modules
      - hostPath:
          path: /sys
          type: Directory
        name: tracing
      - configMap:
          name: kepler-cfm
        name: cfm

Thank you so much, you just saved me from giving up on a project I've been working on for a month ! I will try to deploy these right away.
Thank's again !

@annis-souames looking forward to your good progress!


[Percy|Web-components] Icon components don't appear on the snapshots

For some reason icon components don't appear on snapshots
Even thought they would appear on the storybook page the snapshot was captured from
Percy snapshot

Web-components storybook

A piece of the Percy snapshot

                  <gds-icon name="ArrowClockwise"></gds-icon> ArrowClockwise

                  <gds-icon name="ArrowDown"></gds-icon> ArrowDown

                  <gds-icon name="ArrowLeft"></gds-icon> ArrowLeft

                  <gds-icon name="ArrowRight"></gds-icon> ArrowRight

No longer relevant: We've decided to approach web-components differently (not try to build them out of React)


OpenCalc App Store page not reachable anymore

Hey,
since a couple of weeks the OpenCalc Apple App Store page is not reachable anymore.
https://apps.apple.com/app/opencalc/id1403173317 just shows "Connecting to the iTunes Store..."
It's also not possible to install the app on an iphone/ipad anymore.

@breeko made this great and elegant argument for why you don’t need ads to support simple calculator app, and has gone and proven himself wrong by letting his own free opensource version die. It’s disappointing…

My developer account expired and I was tired of paying $100+ a year to host a few free iOS apps. I think that's the reason you see so few high quality free iOS apps. I was okay with paying the fee while I was building the apps and had higher ambitions for developing in the iOS ecosystem, but paying that $100+ year after year eventually got to me.
I wish there were an alternate distribution method for iOS apps. But the best I can do is open source the product and encourage someone with an active developer's account to host it.
Google has a more reasonable policy of a one time $25 fee. I noticed my Google product was recently taken down as well but that was due to a new checkbox I had to click, so I clicked that checkbox and it's now in review. That should hopefully be back up soon.
I still do think that you don't need ads to support a simple calculator app. And adding ads would not come anywhere near the developer fee anyway. I would have to churn out dozens of clones with very invasive ads and other nefarious tracking... wait it's all starting to make sense...

That is totally fair. I haven’t ever had to maintain an iOS app, so I have no room to criticize. It would be nice if Apple supported OSS, by lowering the developer fee for developers who release OSS without ads. Thank you for releasing this!

Would you be interested in a crowdfunding your developer license through https://geyser.fund? I'll be glad to set up the project on geyser.


Video not working

On google collab, video not working!

This program created two folders. The first with input images. The second (empty file log)

@statho please help

Please see the response to #18.


API-diff between 7.0-preview2 and 7.0-preview3

The bugs we found in the API diffs for Preview1 and Preview2 were fixed here: https://github.com/dotnet/arcade/pull/9172
ASP.NET: @dotnet/aspnet-api-review
WinForms: @merriemcgaw @RussKie
WPF: @dreddy-work @RussKie
Libraries: @danmoseley @jeffhandley @karelz @ericstj @stephentoub
@dotnet/area-extensions-filesystem
@dotnet/area-extensions-hosting
@dotnet/area-extensions-logging
@dotnet/area-extensions-primitives
@dotnet/area-system-runtime
@dotnet/area-system-numerics
@dotnet/area-system-diagnostics-activity
System.Net: @dotnet/ncl
@dotnet/interop-contrib
@dotnet/area-system-security
@dotnet/area-system-text-regularexpressions

I am seeing something strange in the system namespace. here is some example:
-        public static DateOnly MaxValue { get; }
+        static DateOnly MaxValue { get; }

Is this intentional?

I am not seeing System.Composition.Hosting is included. Here is the new exposed APIs https://github.com/dotnet/core/issues/7108#issuecomment-1069723651. Or we are not including the OOB libraries?

The following System.Diagnostics APIs LGTM.
     public class Activity : IDisposable {
+        public bool HasRemoteParent { get; }
     }
     public readonly struct ActivityCreationOptions<T> {
+        public string? TraceState { get; set; }
     }

System.Runtime.InteropServices LGTM.

I am not seeing System.Composition.Hosting is included. Here is the new exposed APIs #7108 (comment). Or we are not including the OOB libraries?

That's my understanding, @tarekgh - We do not include OOBs in this report.


List Item: whitelisted_buyer

https://github.com/paritytech/polkadot-sdk/blob/1bdfb29587800a00aad62acb7222b77b6c2701e7/substrate/frame/nfts/src/lib.rs#L1705

I think this is part we've recently discussed with @jsidorenko

I think this is part we've recently discussed with @jsidorenko for future drops

You can do pre-signatures.


[ca] Fix data race with the reconciler's WaitGroup

Do not call WaitGroup.Add from within the reconciler loop goroutine, since WaitGroup.Add must be called before WaitGroup.Wait is called, and calling it from within the goroutine is racy because it means that the WaitGroup.Wait could be called before the goroutine is actually started.
Signed-off-by: cyli<EMAIL_ADDRESS>

LGTM

Can this code path ever be hit in 17.05?

It looks like it never made it into 17.05:  https://github.com/docker/docker/tree/17.05.x/vendor/github.com/docker/swarmkit/ca


No oidc for local dev

As discussed at last all hands this a test implementation of a system to avoid the loading of the OIDC login system in case we are working on a dev system.
I am not sure if it is the best approach but it is working right now and fix the issues pretty easily.

Deferring this review to @akatsoulas

So we need to remove all the modules of oidc when is on DEV?

I would look into more to the direction of using a different authentication backend when in a dev environment. That said, I haven't spent any time on this so I am not sure if this is going to work

Ok so we can choose the keep this pr opened for other dev that in case need help until we figure out a better solution.


Add avatar orientation getter property to AudioMixer.

Linted, ran unit & integration tests, check SDK doc, and tested using example app.


change to use multi erc20 trace for vk generation

common-rs will be used by roller-rs.  If we read a file with path "./tests/traces/multiple-erc20.json", roller needs to put this file along side the execution binary... seems a bit complex.. I recalled that is why i chose empty circuit

we can embed this into rust code (in  common-rs).

we can embed this into rust code (in common-rs) using "Raw string literal".

@HAOYUatHZ  you mean put content of multiple-erc20.json into code like following ?:
let multiple-erc20_trace = "{
    "jsonrpc": "2.0",
    "id": 1,
    "result": {
        "blockTrace": {
            "number": "0x8b",
            "hash": "0x435c3791f12cb7c0a47c73ade4d173d6ab7ad2fc97a2803474e534dd1c469e55",
            "gasLimit": 7698532,
            "difficulty": "0x2",
            "baseFee": "0x129",";
            ..........

it is doable,  BTW, this file is large (about 90000 lines)

we can embed this into rust code (in common-rs) using "Raw string literal".

@HAOYUatHZ you mean put content of multiple-erc20.json into code like following ?:
let multiple-erc20_trace = "{
    "jsonrpc": "2.0",
    "id": 1,
    "result": {
        "blockTrace": {
            "number": "0x8b",
            "hash": "0x435c3791f12cb7c0a47c73ade4d173d6ab7ad2fc97a2803474e534dd1c469e55",
            "gasLimit": 7698532,
            "difficulty": "0x2",
            "baseFee": "0x129",";
            ..........

yes like
r#'abcd
efg
'

it is doable, BTW, this file is large (about 90000 lines)

yes, but I tink you can put it into a single file like mock_data.rs
and
pub mod mock_data

or somrthing

updated in 780a8a9 to avoid read file from path.

i use include! macro here.  https://github.com/scroll-tech/common-rs/pull/68 seems much cleaner

so, should we merge #68 first then #67?

"./tests/traces/multiple-erc20.json",

merge #67 after mason finished mock proving mainnet blocks


Add an option to not override selected text color

Godot 3.0 master
I just found it would be useful to be able to NOT change text color to black when selecting it, because it would allow customizing a dark selection color without alterating initial text color and syntax highlighting.
Example of this in Sublime Text:

The result in current Godot:

Fixed by https://github.com/godotengine/godot/pull/11407


Only the first image is downloaded from posts with clusters of images

When more than one image is posted in a single post, only the first image is actually downloaded.

!fixed


Nawab_Logger: Resolved logger giving multiple entries

Added a hasHandler() method to check if the logger has multiple handlers in the object instance.
The link to this issue can be found 1 and 2

Looks good as far as I see the debug you shared. Please update the commit message similar to this: https://github.com/Aniketh01/NaWaB/commit/75cb7e9041ddf27018a1b04c34dc1d393abb2a10
Also add fixes #issue_number in the commit

This is part of Nawab_Logger.


Emojis in headings

When you use an emoji in a heading, the emoji appears as a silhouette colored to match the heading text.

Came here to say the same. :) Other than that, this is a FANTASTIC theme for Obsidian! Thank you for making it and sharing it!

same here.
Emojis in all headings (H1 - H6) as well as in highlights are fully colorized:

I love italic emojis! Please keep them! LOL

Hello there!! LYT Developer here — I just wanted to let you guys know that we're working on a fix for this to allow LYT users to continue enjoying the beautiful gradient headers. Please hold on tight, we're getting there!

How's progress on this?

@gitscosh - Things have come up and have been busy for a bit, but very timely of your comment, I'm going to be working on this issue this week! I apologize for the time taken, but the solution hasn't been easy. Glad to say that we're getting closer!!

Hello folks! We have decided to turn on Safe Mode styling for the headers as default (for now) in v.1.1.1 . We still haven't gotten a fix for emojis when using gradient headers - but we are continuously working on it. Apologies! I will keep this issue open.


Sidebar not showing

Hello,
I am trying to implement this sidebar, however after doing a copy paste of the github project, I see nothing except a blank page:

However if i remove the "Relative" attribute in the debugger, everything is fine! :

Hence, I am trying to turn off this default "relative" position to absolute, but with very little success. I read through the issue here, tried a bunch of things (!important, host: >>>, starting from a simpler project, etc.) but none seemed to work.
I generated the project using angular cli, and I am using Angular 5.0.
Thanks a lot for your help!

Does #100 help?

#121 helped me!
 <ng-sidebar-container style="position: static;"> => this still works for me.
Thanks a lot for your help. Cool sidebar!


Injecting after or before not working on windows environments

When using templates with injecting after or before are not respected on windows environment and instead content is injected at the beginning or end of the file respectively. It works on unix environment as expected
Template:
---
to: foo/file.js
inject: true
after: HOOK
---
foobar

Expected result
// foo/file.js

function foo() {
   // HOOK
   foobar
}

Actual result
// foo/file.js

function foo() {
   // HOOK
}
foobar

It works fine when I downgraded to version 5.0.3

The same for me. Doesn't work for Windows 10 with<EMAIL_ADDRESS>However, it works on 5.0.3 version
Btw, didn't test it with other OS