Emit real private methods

In TS, private methods are inaccessible outside the defining class. But in emitted code, private methods are just ordinary JS methods which are accessible outside. I have a suggestion to emit real private methods for JS:
//*** TS code ***
class Greeter {
    greeting: string;
    constructor(message: string) {
        this.greeting = message;
        this.invisible();
    }
    private invisible() {
        console.log(this.greeting);
        this.greeting = 'new value';
    }
}

//*** Currently Emitted Code ***
var Greeter = (function () {
    function Greeter(message) {
        this.greeting = message;
        this.invisible();
    }
    Greeter.prototype.invisible = function () {
        console.log(this.greeting);
        this.greeting = 'new value';
    };
    return Greeter;
}());

//*** Suggested Emitted Code ***
var Greeter = (function () {
    function Greeter(message) {
        this.greeting = message;
        invisible(this);
    }
    function invisible(self) {
        console.log(self.greeting);
        self.greeting = 'new value';
    };
    return Greeter;
}());

Now the emitted private methods are inaccessible from outside. Another benefits is, self (the alias of this) and the private method name can be minified and even inlined by tools like uglyfyjs and google closure.
I've been using this kind of way to implement JS private methods in my projects. Per my experience, I haven't run into any side effects. And there's not performance implication either, here is a blog about this: http://andrewkelley.me/post/js-private-methods.html

This would break any indirect uses of the method, break apply/call/bind, change the arity of arguments.length in unexpected ways, break use of arguments in the function body itself, and change the class prototype.

Yes, it will break the cases as you mentioned. So what about providing a compiler option, e.g. hidePrivateMethods? By default, it's false, but if some developers will take care of those cases and when it's safe to perform this optimization, they can set this option to true.

We've gotten dozens of different "emit private things differently" requests and don't want to add flags for any of them (let's not even talk about how all of them would interact...). private is a compile-time construct only and the amount of care you need to actually completely hide something from outside observers is beyond what we could reasonably provide. This is doubly-so for ES6 emit, where private should simply evaporate and preserve all other semantics.

Dupe of #684, #8299, #13879 and discussed in the FAQ.
There are ways to construct things where the class can have a reference to a private WeakMap and not leak those on the instance, which is semi-sort-of how the TC39 proposal of how private fields would be implemented (actually it uses internal slots, but could be transpiled using a WeakMap).
It is also worth noting that it doesn't make any sense to change private and the emit at this point because likely TypeScript will want to/need to adopt the private fields proposal when it gets further down the path of being accepted.  It is at Stage 2 and being actively worked on.


Enhance setting of HTTP response types

Our current implementation of setting the HTTP response type is currently a workaround.
This is due to upstream bugs in angular
After this was fixed upstream, we should take a cleaner solution than handling it the way we do now.

outdated


🐛 Procution build failling with diagram.md

Cc: @matt-goldman @bradystroud

Hi Team,
Describe the Bug

The production build failed 😣.
It seems like Gatsby was trying to create a page for diagram.md.
https://github.com/SSWConsulting/SSW.Rules/blob/982fb2245fe90351f37e6bb1f2aae2202e2655ab/gatsby-node.js#L108C1-L111C10. This code indicates that markdown files without the types 'category,' 'top-category,' or 'main' will be used to generate a rule's page. This could potentially lead to build errors in production. To address this issue, we should add a new type for 'diagram.md' and exclude this type of file when creating a page.
Expected Behavior

The build should complete normally.
Tasks

[ ] Investigate
[ ] Skip the type diagram when creating a new page
[ ] Add the new type to diagram.md
[ ] Make the build successful

Screenshots

Figure: Error message displayed in Azure pipeline
Thanks!

Thanks @Aibono1225. I didn't know about this and thought this would be a good way to store the diagram along with the rule.

This code indicates that markdown files without the types 'category,' 'top-category,' or 'main' will be used to generate a rule's page. This could potentially lead to build errors in production. To address this issue, we should add a new type for 'diagram.md' and exclude this type of file when creating a page.

I don't know how this actually works under the hood, but wouldn't it make more sense to for this to only build pages for rules.md files, rather than excluding pages not to build?

Done - this issue is done as per https://github.com/SSWConsulting/SSW.Rules/pull/1112


Install mixins based on porter.yaml during build time

It would be great if porter build can install all the necessary mixins based on the list in porter.yaml file during build time. If those mixins are already installed porter build can just skip them.
Currently we have to install mixins separately though there is a list defined in porter.yaml.
as far as tool's installation is concerned customer need to  install only porter

That's a really great idea!

This has been expanded upon and is tracked in the epic #975


Remove happy tests

Problem
Happy contains a single test (multicast) that is currently very flaky in CI, however I could not reproduce the error locally.
Since the happy platform seems to not be that used and we have alternatives (cirque for full end-to-end with multiple hosts), it seems easier to just remove the happy version instead of trying to debug the flakyness (I was unable to - we don't even seem to preserve debug log artifacts)
Change overview
Remove the happy test
Testing
CI validates this

/rebase

Rebasing to see if this works, failing a lot this weekend...

Fast track: this PR has been up while trying to figure out the reason for happy failures and it could not be resolved.
PR does a pure deletion.

Is the functionality tested by happy already covered by cirque?

Is the functionality tested by happy already covered by cirque?

Not as far as I am aware. It is a single test that validates 'multicast works with 5 nodes' from what I can tell. The problem I have with this test is that it seems to be quite flaky and the flake never uncovered any bugs. I am restarting builds several times a day due to this test and I see it causing more pain than value.

Removed fast track: had to iterate over it quite a bit and the dns tests may be a material change.
For DNS tests, the state right now is that the tests will run on darwin and not on linux
For the multicast tests - they are gone but would be exercised if we ever run some minmdns tests or group tests - I believe that may be the better path. We should use cirque or setup simpler scripts (i.e. more reliably reproducible/debuggable than happy)
Feedback would be appreciated: @mspang @cecille @yunhanw-google @erjiaqing or other folks with experience with happy.

fast track: PR up for a while and had chats with people familiar with happy and now the PR has more checkmarks.


Fixing default behavior for ResourceNameTreatment

LGTM

Current coverage is 81.34% (diff: 0.00%)

Merging #721 into master will not change coverage

@@             master       #721   diff @@
==========================================
  Files           292        292
  Lines         11123      11123
  Methods           0          0
  Messages          0          0
  Branches       1465       1465
==========================================
  Hits           9048       9048
  Misses         1673       1673
  Partials        402        402

Powered by Codecov. Last update 55ca536...a263df4


NO-JIRA: fix(gha): replace oc with kubectl in notebook_controller_integration_test.yaml

https://github.com/opendatahub-io/kubeflow/pull/417

We don't have oc preinstalled on the new GitHub Actions runners that we were autoupdated to. Best to stick to kubectl.

btw, is this intended intentionally against this branch? Please, link this with relevant upstream change once possible as we should go from upstream first ideally.

I wanted to quickly try... Also, I did the change in github webui and I can't edit multiple files that way

First, I think we should merge your revert independently of this one
The ci fail here was a flaky failure, fixed by rerun; I'm adding a retry to the place where it failed in a different PR

/lgtm

/approve


My CPU freezes when I replaced the given dataset with a new one.

I am a beginner in deep learning so please help me out.
I replaced the dataset with 8 different images. The images in the new datset are not of shape 512X512.
Data augmentation goes on for a long time without stopping even after reducing steps per epoch.
How do I resolve this?
Should I resize all images to 512*512?

@Tao-Zhou thanks for replying,
Yes the code is running fine now but the problem is that the predicted test images are way off track. How do I resolve this? I trained it for 500 steps per iteration for 2 epochs. Should I increase the steps?

@akashsmaran maybe, I'm not sure about that. I'm also a beginner in this field. sorry


Define best practice for cleanup

The pattern we want to encourage is to call get_settings when an app is initialized and store the results in the appropriate structure (django settings module, Pyramid app config, etc.).  It would be nice to have a method to clean up the internal data of the backends, and if necessary release internal resources.
Proposed API: add Store.close that calls backend.close
Bonus: add Store.__enter__ and Store.__exit__ to call close automatically

Edited title to reflect the underlying goal.
The idiom I’ve used for django projects is to have all the get_setting calls at the top of the settings module to see misconfiguration errors early, and use the results later in the file as usual.  Something like:
# line 10
_database_url = store.get_setting('APP_DATABASE_URL')
_database = dj_database_url.parse(_database_url)

# line 90, after INSTALLED_APPS and all
DATABASES = {'default': _database}

The first thing learned here is to avoid names like DATABASE_URL, as these would be printed by the django debug page without masking the password in the URL.
The second thing is that the intermediary variables (_database_url and _database) live forever in the module, and the store object itself with its backends could also be accessed by other code.
In a Pyramid app, the store object only lives temporarily in the top-level includeme function, so this cleanup problem doesn’t exist.
Implementing __enter__/__exit__ to support a with statement would not look great, forcing indentation on the whole get_setting section, and would not solve the issue with intermediary variables.
Adding Store.close or recommending del store could be better but doesn’t solve intermediary variables.
Recommending del store, _backends, _database_url, _database, _cache_url, etc doesn’t look great.
Solutions I consider: define a function in the settings module to hide things, del store, _backends, _get_setting at the end of the module; forget about early errors and move the Store.get_setting calls to where they belong in the module.
(Bonus: my examples have _backends since I typically have a dynamic list of configstore backends depending on the presence of an envvar naming a dotenv file; this would be nicer with a Store.add_backend method.)

(Now we don’t have to mention _backends thanks to #18 / v0.3 that removes the need for a separate variable.)

(Edited to add solution 3 which I’ve been using in the last months)

Closing, solution 3 seems good enough.


Dropdown: placeholder value

Steps

Open codepen.
Click on Dropdown element, it's value will be set to Category 1
Click outside, Dropdown's value will be again Category

Expected Result
Until Dropdown's item will be selected, keep placeholder as Category.
Actual Result
After you click on Dropdown it changes value to first option.
Version
Latest.
Testcase
http://codepen.io/pzurek/pen/mRJMov

@levithomason I'm not sure that this behaviour is bug. Can you clarify?
Based on stackoverflow question.

I believe this is the expected behavior and in line with SUIR core:

The difference we have is that the dropdown is not making Category 1 active on blur, whereas, SUIR core would.  We are also changing the placeholder rather than the text.  This makes our interaction more jarring than SUIR core.
Proposals, on selected (highlighted) item change :

[ ] change the text, not the placeholder, for selection
[ ] change the placeholder only for search Dropdowns
[ ] do no change text for regular Dropdown menus

(I responded on SO as well)

We've largely addressed these issues now in the latest version.  Feel free to open if you think more needs done.

@levithomason I reopened this issue because it wasn't fixed and I want to pick up it.

Hi, I'm needing this exact behaviour as well, as described by levithomason. I'd be happy to come on as a test resource.


Update indexer and allow search by author, version and keyword

This PR resolves the request : https://github.com/verdaccio/verdaccio/issues/345.
Refactor: Updated Lunr.js through the library lunr-mutable-indexes. The decision was made in accordance with this issue.
Feat: Added keywords and version indexes, so the user can search for these tags.
Future: Write types for lunr-mutable-indexes. For now I've used "stub-create" with the intention to delivery this PR as soon as possible.
PS: I wasn't sure about the boost. Ex:  this.field('keywords', {boost: 7});
Feedbacks welcome 😄

@juanpicado ok...maybe I should also change the test, due the keywords prop..

@juanpicado fixed :)


Owner

Copilot Chat Extension Version:
VS Code Version:
OS Version:
Logs:

Steps to Reproduce:

Please elaborate


Bug Report: Null Object Reference in Charter if vocals are shorter than song.

If you are playing a downloaded version of the game, what operating system are you using?
Windows (x86), Windows (x86_64), Linux, or macOS? Specify below.
What version of the game are you using? Look in the bottom left corner of the main menu.
Kade Engine v1.7
Please describe your issue. Provide extensive detail and images if possible.
When I reach the end of the vocals of my track, if the music is a bit longer (i.e. the instrumental continues for a second or two), a crash will occur. A crash does not occur in Play mode.
Have you identified any steps to reproduce the bug? If so, please describe them below. Use images if possible.

Create a song whose vocal track is shorter than the instrumental track. This is unlike most of the game's songs whose vocal track continues (with silence) until the end of the instrumental.
Play the song ingame. No bug occurs.
Play the song in the charter.
A Null Object Reference occurs.

Fixed by #1944


Wrap all order extension hooks in try/catch blocks.

This allows extensions to interrupt updates to the cart.
Update CartForm to collect/display bad messages from shopping-cart.

The goal of this is to provide a short-term solution to the problem discussed here: #554


documentation: Clarify deployment requirements.

This commit removes the false statement that deploying
a bot requires an own Zulip development server and
updates the instructions respectively.

Automated message from Dropbox CLA bot
@derAnfaenger, it looks like you've already signed the Dropbox CLA. Thanks!

Merged, thanks @derAnfaenger!  I did a few tweaks on top of this; can you review the current RTD version and see if you can think of additional changes?

@timabbott I read through it, seems fine to me, except for the paragraph describing the test of the followup bot. This was the standard test bot during GCI, a task was associated with running it :). I don't think it is a good choice for a "test-your-first-bot" bot: Especially now that the doc explicitly mentions the deployment of bots on chat.zulip.org, we don't want the followup stream to be spammed by people trying out their first bot. I think we should write a new bot similar to this one called smt like "tryme.py" that could e.g. send "hello zulip" messages to the test stream and use it in the docs.

Yeah, that sounds like a good follow-up project.  I think a good idea for a sample bot would be one that sends a PM to the anyone who mentions it, since it (1) shows the interactive model, and (2) doesn't have the bot post anywhere public.


Update interview to reflect upcoming changes in Small Claims law.

@nicoledimitri Is there a specific change you had in mind for this issue?

No, I just recall the Trial Court analysts mentioning that there would be changes to the Small Claims process next year. I put a note here just in case they informed us of specific changes that would affect the interview.


Adding support for running integration tests from golang

Generally useful for helping to debug integration tests. This gives us
the option of running the integration tests within an IDE
(e.g. GoLand).
The new golang test is defined by driver_test.go. As an artifact of
this change, I split out the main method and flags into main.go.
infra.go is the shared code used by both main.go and
driver_test.go.

@nmittler: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/istio-pilot-e2e.sh
f05922bba14a710c40e32f66c3bdc2f444dea6d5
link
/test istio-pilot-e2e

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

It's very unlikely the tests will work in circleci as is - they are not unit tests, but the get picked by the makefile.  To get pass this, I see 3 options:

move the files to top level tests/integration (next to the other integration tests - in future we want to converge, including reusing some of the common methods to setup and fetch logs fro the e2e tests)
exclude the tests with some regex or make trick
add a "UNIT_TEST" env variable, and in the test skip if the env is set.

Probably other options exist, I would prefer 1 or 3.

I don't mind keeping main in the short term - but it should be clearly
marked as deprecated (maybe print a message), and it should
have some comments indicating on what is missing from 'go test' and what is
the plan.
In particular I don't see how the flags in main are reflected in the 'go
test' mode - so I doubt anyone could really use the go test
in practical ways ( and unit tests are already broken in circleci ). I
haven't check prow pre-submit time, AFAIK it's also running
all tests so now will try to run pilot integration (and twice)
On Wed, Feb 7, 2018 at 8:11 AM, Nathan Mittler<EMAIL_ADDRESS>wrote:

@nmittler commented on this pull request.
In pilot/test/integration/main.go
https://github.com/istio/istio/pull/3246#discussion_r166667562:

flag.StringVar(&params.AdmissionServiceName, "admission-service-name", params.AdmissionServiceName,

"Name of admission webhook service name")

flag.IntVar(&params.DebugPort, "debugport", params.DebugPort, "Debugging port")

flag.BoolVar(&params.debugImagesAndMode, "debug", params.debugImagesAndMode,

"Use debug images and mode (false for prod)")

flag.BoolVar(&params.SkipCleanup, "skip-cleanup", params.SkipCleanup,

"Debug, skip clean up")

flag.BoolVar(&params.SkipCleanupOnFailure, "skip-cleanup-on-failure", params.SkipCleanupOnFailure,

"Debug, skip clean up on failure")

+}
+
+// Main entry point for integration test executable.
+func main() {
The point of this PR is to maintain what we have today, which is an
executable that runs our integration tests. The main.go simply moves the
main function to its own file, this isn't new.
What's new in this PR is driver_test.go, which is a golang test. If you
were to run go test (and had the appropriate environment variables set)
this is what would be run (not main).
I expect that we'll eventually remove main.go in favor of driver_test.go,
but we need to make sure that all uses of main are swapped over to use
golang tests first.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/istio/istio/pull/3246#discussion_r166667562, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAFI6sAvxkiygoULcukxDRQgAE3mBBoaks5tScstgaJpZM4R76ww
.

@costinm PTAL
I've restructured the integration test to use testing.T for the individual test classes.  I've also added an environment variable RUN_ISTIO_INTEG_TESTS to control whether the integration tests are run.

I have two suggestions that can be done later:

Test binaries allow coverage collection. That would be a wonderful way to bump up coverage if we can compile pilot into a test binary.
Can we use some guard not to run environment-depending targets as part of regular go test. I think that go generally trusts that tests are isolated (e.g. do not share environment like a cluster) and self-contained (since test results are cached, a change in the cluster should invalidate the cache).

That would be a wonderful way to bump up coverage if we can compile pilot into a test binary.

https://groups.google.com/a/google.com/d/msg/istio-mixer/UzrQAFyFvHE/jeKvTJpXDAAJ could be used to run a local instance of pilot built as a test binary. Additional firewall rules may be needed for this approach.

Can we use some guard not to run environment-depending targets as part of regular go test.

Build tags are one option here, e.g.
// +build test_extern_env

go test -tags test_extern_env

@ayj, @kyessenov PTAL
@ayj good suggestion on using build tags ... didn't know they existed :). I've added an integration build tag to the file and converted the test to a TestMain ... not sure it really matters, but it seemed more appropriate. I'm also skipping the tests when testing.Short().

https://groups.google.com/a/google.com/d/msg/istio-mixer/UzrQAFyFvHE/jeKvTJpXDAAJ could be used to run a local instance of pilot built as a test binary. Additional firewall rules may be needed for this approach.

It's absolutely on my radar to support running Pilot/Mixer locally as this framework evolves.  I've already been talking with Zack about it ... stay tuned.

Could you document build tags in developer guide if you do decide to use them?

Sorry, didn't see this - IMHO build tags create more problems for the build
system ( we need to build the test 2x), and little benefit since
we really just need to exclude the entire directory. They are meant for
other things - platform specific code, optional features.
Just move the entire directory to istio/test - next to all other
integration tests. This may also allow more code reuse and visibility.
I think it is critical to get rid of the current intialization in pilot
tests, so the setup step can be shared and be consistent across
all  e2e tests ( e2e_simple in particular ), it will also fit with some of
the automation that k8s is doing on their side.
On Wed, Feb 7, 2018 at 5:51 PM, Nathan Mittler<EMAIL_ADDRESS>wrote:

@ayj https://github.com/ayj, @kyessenov https://github.com/kyessenov
PTAL
@ayj https://github.com/ayj good suggestion on using build tags ...
didn't know they existed :). I've added an integration build tag to the
file and converted the test to a TestMain ... not sure it really matters,
but it seemed more appropriate. I'm also skipping the tests when
testing.Short().
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/istio/istio/pull/3246#issuecomment-363976020, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAFI6sSQS9oEsX9K-t_O-AD1xTq9wlt7ks5tSlMzgaJpZM4R76ww
.

To clarify: we spent a lot of time to optimize the CI pipeline, I don't
mind removing the tag in a separate PR, but long
term moving the code is a better solution. IMHO it would be cleaner/better
to just keep all integration tests together,
but if you want to do it in separate PR it's ok.
On Thu, Feb 8, 2018 at 8:09 PM, Costin Manolache<EMAIL_ADDRESS>wrote:

Sorry, didn't see this - IMHO build tags create more problems for the
build system ( we need to build the test 2x), and little benefit since
we really just need to exclude the entire directory. They are meant for
other things - platform specific code, optional features.
Just move the entire directory to istio/test - next to all other
integration tests. This may also allow more code reuse and visibility.
I think it is critical to get rid of the current intialization in pilot
tests, so the setup step can be shared and be consistent across
all  e2e tests ( e2e_simple in particular ), it will also fit with some of
the automation that k8s is doing on their side.
On Wed, Feb 7, 2018 at 5:51 PM, Nathan Mittler<EMAIL_ADDRESS>wrote:

@ayj https://github.com/ayj, @kyessenov https://github.com/kyessenov
PTAL
@ayj https://github.com/ayj good suggestion on using build tags ...
didn't know they existed :). I've added an integration build tag to the
file and converted the test to a TestMain ... not sure it really
matters, but it seemed more appropriate. I'm also skipping the tests when
testing.Short().
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/istio/istio/pull/3246#issuecomment-363976020, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAFI6sSQS9oEsX9K-t_O-AD1xTq9wlt7ks5tSlMzgaJpZM4R76ww
.

@costinm I totally agree.  My plan was to evolve this into a more flexible framework that could be used for all of our larger tests, so I think we're on the same page.  Perhaps we can chat offline?
WRT tags, I don't think you need to build and test 2x ... if you're building on a system that is set up for k8s, you simply build once with the integration tag.  All tests would be built and run in that case (including the integration tests). Regardless, for now, having the tag properly excludes it from the default build, which is what we want.  We can discuss the best way to enable/disable integration tests once we replace the current main entirely.  Sound reasonable?

can we invoke pilot e2e tests in circleci using make test .. instead of using pilot/test/integration/.. ? Heck, we could even remove building those test binaries. But will that cause Go to rebuild the entire code in e2e-pilot ? That would be a bummer, as we optimized the build pipeline using workspaces for this very purpose.

@costinm @rshriram @ayj I've reworked this a bit to move all of the files to tests/e2e/tests/pilot, as suggested by @costinm.  This allowed me to remove the use of tags and also makes the tests more consistent with the others (albeit without use of the common framework ... baby steps :)).

linters not happy:
tests/e2e/tests/pilot/auth_exclusion.go:23:1:error: authExclusion is unused (deadcode)
tests/e2e/tests/pilot/egress_rules.go:30:1:error: egressRules is unused (deadcode)
tests/e2e/tests/pilot/grpc.go:23:1:error: grpc is unused (deadcode)
tests/e2e/tests/pilot/headless.go:23:1:error: headless is unused (deadcode)
tests/e2e/tests/pilot/http.go:25:1:error: http is unused (deadcode)
tests/e2e/tests/pilot/infra.go:140:1:error: newInfra is unused (deadcode)
tests/e2e/tests/pilot/ingress.go:28:1:error: ingress is unused (deadcode)
tests/e2e/tests/pilot/kubernetes_external_name_services.go:23:1:error: kubernetesExternalNameServices is unused (deadcode)
tests/e2e/tests/pilot/routing.go:31:1:error: routing is unused (deadcode)
tests/e2e/tests/pilot/routingToEgress.go:32:1:error: routingToEgress is unused (deadcode)
tests/e2e/tests/pilot/tcp.go:24:1:error: tcp is unused (deadcode)
tests/e2e/tests/pilot/test_api.go:19:1:error: test is unused (deadcode)
tests/e2e/tests/pilot/zipkin.go:30:1:error: zipkin is unused (deadcode)
Makefile:241: recipe for target 'lint' failed
make: *** [lint] Error 1

@costinm mind re-approving now that the route tests have been fixed?


Need documentation - Sensu client signature

Except for some sparse information on Sensu client signature in changelog, I cannot seem to find any other reference to client signatures anywhere else.
Even the official Reference documentation does not have any mention.

see https://github.com/sensu/sensu-docs/issues/393

Duplicate of sensu/sensu-docs#393, closing.


Laravel 9.x Compatibility

This is an automated pull request from Shift to update your package code and dependencies to be compatible with Laravel 9.x.
Before merging, you need to:

Checkout the l9-compatibility branch
Review all comments for additional changes
Thoroughly test your package

If you do find an issue, please report it by commenting on this PR to help improve future automation.

:warning: The latest version of Laravel has a dependency for phpunit/phpunit of ^9.3. If you would like to also upgrade your tests, you may run the PHPUnit 9 Shift for free.

:alembic: Using this package? If you would like to help test these changes or believe them to be compatible, you may update your project to reference this branch.
To do so, temporarily add Shift's fork to the repositories property of your composer.json:
{
    "repositories": [
        {
            "type": "vcs",
            "url": "https://github.com/laravel-shift/laravel-rating.git"
        }
    ]
}

Then update your dependency constraint to reference this branch:
{
    "require": {
        "compubel/laravel-rating": "dev-l9-compatibility",
    }
}

Finally, run: composer update


Enhance tab component keyboard and screenreader guidance

Suggestion from a recent Accessibility Audit.
Add content to explain how to operate tabs via keyboard, and for how a screenreader should announce it.
From Dig Inclusion: "User should be able to change tab via Tab key and Arrow keys, but should not move tab unless pressing Enter key. Screenreader should announce the current tab and the total number of tabs (similar to lists, e.g. 2 of 4)."

Updates live


ace-editor demo in the works?

The new yjs.dev demo is fantastic! Huge improvement over the y-js.org site I saw last year.
Any chance an ace-editor demo is in the near future pipeline? Saw it mentioned in your FOSDEM talk and hoped to find it here. Really interested in testing differences between syncing with websocket vs webRTC and the potential of offering both depending on usecase.

I replied to this here https://discuss.yjs.dev/t/ace-editor-example-for-v13/68


Dev mode seems broken on 1.5

Hi,
from 1.5 onwards the reload in the dev auto reload mode seems to be broken for elder routes on my system.
If this is a system configuration (Linux, Node 16.5) issue i can provide some more logs but im hoping this can be verified independently on your end.
I believe this is an error in regenerating the HTML but am not familiar enough with the rollup/esbuild plugins to debug it myself.
This is all on a fresh elder template retrieved via npx degit Elderjs/template elder-demo which uses a >=1.5 elderjs version.
When i start npm run dev and modify a component in the "components" subfolder (Clock.svelte), the the change is picked up by the watcher, is compiled and both JS, and the HTML is updated as expected.
However, if i modify a route file (Home.svelte,  changing the h1 tag) the change is picked up by the watcher, the js is compiled, but the html is not updated! The browser does not reload, and if i manually do, the css and js is broken since the old html points to the wrong asset hashes.
On 1.4.16 this still works fine, on 1.5 and following it does not.
This also affects esbuild.

Not experiencing these issues and working in Elder across multiple teams daily.
There was an issue in earlier versions of 1.5 but current doesn’t have any besides a css import/caching issue in dev mode which I just identified today.
Can you try deleting your package.lock and making sure you are on latest?

I’d love more logs on this if you have them. Happy to dig in.

Since its works on your end i did some more digging. So the issue is that the server is not restarted after a change of the route files.
I believe there is an issue with the chokidar package used to detect file changes on (my) linux. I guess you are using macosx, which this plugin is natively designed to support?
I did some "console.log" debugging on the change handler in https://github.com/Elderjs/elderjs/blob/2f3f8c69d421ab490ae776eee157bec4d0050bd4/src/rollup/rollupPlugin.ts#L339-L345 and it does not pick up all changes.
Most importantly it misses the changes in the "ELDER/compiled/routes" folder which would contain the changes in the home route. Maybe since it has to fall back to polling on linux it gets overwhelmed by the many changes?
What hides this somewhat, and hides this issue on the pre v1.5 versions is that the important "startOrRestartServer()" is also called by the "writeBundle()" in the same file https://github.com/Elderjs/elderjs/blob/2f3f8c69d421ab490ae776eee157bec4d0050bd4/src/rollup/rollupPlugin.ts#L529-L532
This is also called on all changes (?) and triggers a restart if the type == "client".  Hence the restart working on my system if a client component is changed. In the pre 1.5 versions this type check is missing, https://github.com/Elderjs/elderjs/blob/58e027ab8f851992873130b638bea76c31ef1130/src/rollup/rollupPlugin.ts#L451-L465 and the server is restarted after every "writeBundle()" build. This then picks up the changes in the route.
There is a chance that this is just my linux system maybe someone else on linux could try to reproduce?.

I believe there is an issue with the chokidar package used to detect file changes on (my) linux. I guess you are using macosx, which this plugin is natively designed to support?

Yep, Mac OS, though one team member is on Linux Arch and he has mentioned having to restart to get changes, IIRC. I will ask him more about his experience to see if he can recreate it.
I know @lukeed coached me through an issue with polling and chokidar so I will ping him as well.

Just confirmed with a team member, he has issues on and off with changes not being detected in Arch Linux.

FYI: This also happens on Windows 10.
Tested on a clean npx degit Elderjs/template svelte-elderjs2 install.


Scala Stream Collector: can't parse all useragents?

Not sure where in the code it's coming from, but I sometimes get the following warning:
05:23:09.567 [scala-stream-collector-akka.actor.default-dispatcher-12] WARN  s.can.server.HttpServerConnection - Illegal request header: Illegal 'User-Agent' header: Invalid input '=', expected TokenChar, '/', OptWS, Comment, ProductVersionComment or EOI (line 1, pos 138):
Mozilla/5.0 (iPhone; CPU iPhone OS 6_0_1 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A523 Safari/8536.25 t=/eIf6uJm7bq+TQw7s39CJg==DMTVmSsvTYYvgFAgMkVQrp==

Following up on that issue we're seeing lot of similar errors caused by the iOS/Android Facebook apps custom user agents:

00:58:02.290 [scala-stream-collector-akka.actor.default-dispatcher-9] WARN  s.can.server.HttpServerConnection - Illegal request header: Illegal 'User-Agent' header: Invalid input '[', expected ' ', '\t', LWS, Comment or ProductVersionComment (line 1, pos 156):
Mozilla/5.0 (Linux; Android 6.0.1; SM-G930F Build/MMB29K; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/53.0.2785.124 Mobile Safari/537.36 [FB_IAB/FB4A;FBAV/<IP_ADDRESS>.72;]
^

00:58:02.367 [scala-stream-collector-akka.actor.default-dispatcher-9] WARN  s.can.server.HttpServerConnection - Illegal request header: Illegal 'User-Agent' header: Invalid input '[', expected ' ', '\t', LWS, Comment or ProductVersionComment (line 1, pos 113):
Mozilla/5.0 (iPhone; CPU iPhone OS 10_0_2 like Mac OS X) AppleWebKit/602.1.50 (KHTML, like Gecko) Mobile/14A456 [FBAN/FBIOS;FBAV/<IP_ADDRESS>.141;FBBV/34183777;FBRV/0;FBDV/iPhone8,1;FBMD/iPhone;FBSN/iPhone OS;FBSV/10.0.2;FBSS/2;FBCR/OPTUS;FBID/phone;FBLC/en_GB;FBOP/5]
^

00:58:02.842 [scala-stream-collector-akka.actor.default-dispatcher-5] WARN  s.can.server.HttpServerConnection - Illegal request header: Illegal 'User-Agent' header: Invalid input '[', expected ' ', '\t', LWS, Comment or ProductVersionComment (line 1, pos 101):
Mozilla/5.0 (iPad; CPU OS 7_1 like Mac OS X) AppleWebKit/537.51.2 (KHTML, like Gecko) Mobile/11D167 [FBAN/FBIOS;FBAV/<IP_ADDRESS>.141;FBBV/36454510;FBRV/0;FBDV/iPad2,5;FBMD/iPad;FBSN/iPhone OS;FBSV/7.1;FBSS/1;FBCR/;FBID/tablet;FBLC/en_GB;FBOP/5]

Hi @alexanderdean,
i commented on the spray github, as we see an increasing amount of requests being discarded by the collector, as the useragent does not seem to be valid. From my point if view, this is hurting snowplow, as it makes us lose a significant amount of requests. See here: https://github.com/spray/spray/issues/458#issuecomment-306763534

Hey @christoph-buente - I believe Spray is no longer supported, and has been superceded by Akka HTTP.
I suggest we do two things:

Upgrade to the latest version of Akka HTTP for the collector - we should do this anyway
Lobby the Akka HTTP team to see if they would consider tolerating non-RFC compliant useragents
Consider a fork of Akka HTTP if they reject the idea

Thoughts?

Haha, got a nice answer :) You are right, spray is not supported anymore for several years. https://github.com/spray/spray/issues/458#issuecomment-306798110
Going forward with akka http sounds good to me.

Hey @BenFradet - does R92 solve this? If so, we should move this ticket in...

it's already in r92, the move to akka-http should solve it by itself since akka-http is more relaxed than spray as far as ua are concerned from looking at the code. I had an integration test planned for this.

A bit of an update on this: due to the parsing rules having been relaxed in akka-http less user-agents produce warnings.
However, despite the log messages, they are all successfully processed by the collector and further downstream.
Closing, thanks :+1: .


🐞 CodeEdit opens most files as blank text files even when a workspace is active

Description
Related to #1026
Basically files other than supported images are opened as blank text files.
Tested formats
Images (the ones Preview can open, works as normal): .cur, .djvu, .jpg, .jpeg, .png, .heic, .gif, .bmp, .ico
Audio: .mp2, .mp3, .flac, .aac, .m4a, .wav
Videos: .hevc, .3gp, .opus, .wmv, .vob, .mpeg, .mkv, .m4v, .webm, .avi, .mov
Archives: .7z, .rar, .zip
Documents:  .pdf, .bin, .ppt, .doc, .ods, .azw3, .mobi, .dfont, .woff
.csv works as a text file
To Reproduce
Attempt to open any of the above files in CodeEdit
Expected Behavior
To either preview the file, show an informative message or a placeholder file icon.
Version Information
CodeEdit:  0.1.0-alpha
macOS: 14.4.1
Xcode: 15.3
Additional Context
Xcode shows a thumbnail image (same one that shows up in Finder) when it is unable to preview a file.

Although, the file icons in the Project Navigator tries to be as close to the file type as possible.

Screenshots

I’m currently working on this


Styling

Just found out stylish-haskell and hindent don't agree with how to format imports.
Stylish-haskell actually does do much, so I think just hident is good enough. Besides, we dont want to go through two steps just to format. What do you think?

Keeping it simple is probably a good idea yes. Sounds good to me.

Ok, so I will send another PR for files with only hindent formated but not stylish-haskell

Oh, sorry if merged this prematurely.


Node Reseted

Hello,
My B1 server has stopped today after 3 days later. This is what I seen

As you see there is no any error, I checked the kern.log there is no any too:
(I sent you the file)
Then I tried to concordium-node-retrieve-logs but it gave me empty log file as you see:

I tried to take log to times but same:

After all, I restarted the node for see what block it stopped, but what I see:

Node has totally reseted
I'm sorry can't give you log because it's empty.
But I'll send you<EMAIL_ADDRESS>kern.log if you want to see.

Thanks for the detailed info. I have received your log. We will look into it.

Can you provide a bit more description of your system?
One thing that might be relevant is if you run docker container list and post the output of that. It might tell us what happened to the node and why the logs are not accessible.

I can pm ip and pass if you want, I'm thinking destroy already, no problem.

Interesting. Based on the limited allocated RAM I suspect that your node got killed due to trying to allocate more than 512MB.
Is 3 days ago also when you started the node the first time? Can you run docker logs 24e96815a720?

Yes I can run, here: https://paste.ubuntu.com/p/MtQZKj4Tn3/
Yeah there it is, probably cache ram not enough because when I checked ram and disk after kill there both under usage. Yes the system is not enough but this reaction should't be like this, at least node stay stopped not purged.
Also my B2 killed same reason I think, same system spec. I just missed one step, this one happent both when I run the start command.

I just started with a new server and node with these spec yesterday, let's see what's going on

Those specs should be sufficient now.
From the logs you just attached it looks like the cause of failure was actually lack of disk space, which led to partial database corruption, and thus your node could not restart. I can't see precisely what happened to the container you were running, but seeing that docker containers have some space overhead, it is likely that either it was partially corrupt, or deleted.

@ZaferGraph what is your zone in Vultr for this nodes? Silicon Valley?

@ZaferGraph what is your zone in Vultr for this nodes? Silicon Valley?

It was NY, currently I'm in Netherland

Silicon Valley area is very unstable. One of my nodes was stopped and erased, so I lost all of my logs. I suppose this may happened with NY too. By the way, Amsterdam has one incident too, since I'm use it in Concordium.


3/1 Publish

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs-ref-autogen/network/vnet/subnet.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/sql/db.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/sql/elastic-pool.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/network/lb.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/sql/server.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/sql/db/replica-link.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/sql/server/firewall-rule.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/sql/server/service-objective.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/network/vnet.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/network/application-gateway/url-path-map.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/index.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/sql.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/vm.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/network/nic.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/network/vnet/peering.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/vmss.pycliyml
:white_check_mark:Succeeded
View

docs-ref-conceptual/overview.md
:white_check_mark:Succeeded
View

docs-ref-autogen/TOC.md
:white_check_mark:Succeeded

breadcrumb/toc.yml
:white_check_mark:Succeeded

docs-ref-autogen/network/application-gateway.pycliyml
:white_check_mark:Succeeded
View

docs-ref-autogen/network/public-ip.pycliyml
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


GAE的支持

请问jieba可放上GAE吗？谢谢。

I think what this issue is saying is "Can Jieba be used on Google App Engine?" and jannson's response is "well, creating the temp files doesn't work".
That's also what I'm finding:
Traceback (most recent call last):
  File "/base/data/home/apps/s~dokibo-dict/20161021t175549.396505411313804719/lib/jieba/__init__.py", line 123, in initialize
    self.tmp_dir or tempfile.gettempdir(), cache_file)
  File "/base/data/home/runtimes/python27/python27_dist/lib/python2.7/tempfile.py", line 45, in PlaceHolder
    raise NotImplementedError("Only tempfile.TemporaryFile is available for use")
NotImplementedError: Only tempfile.TemporaryFile is available for use

What approach could be used to fix this?

@astromme
Maybe you can make a patch to gae....tempfile.py
like this :  https://github.com/liantian-cn/jieba-gae/blob/master/lib/tempfile_gae.py
Then just replace import tempfile for import tempfile_gae as tempfile , in the error of the file.
like this : https://github.com/liantian-cn/jieba-gae/blob/master/lib/jieba/init.py
It looks good now : https://jieba.liantian.me/
note:
If you replace tempfile.py directly, do not use tempfile_gae.py, the development service is not available.


Create pt-br.json

This should probably include a change to module.js to include the pt-br language in the manifest.


How to calculate Flops and Params?

Hi, I see you calculate Flops and Params in your paper. I find some codes on the Internet but cant't run those. Could you please share codes about this? Thank you very much!

refer to https://github.com/yangxue0827/RotationDetection/blob/main/tools/train_base.py#L25
But we found that the Flops calculated by this method are not accurate, so we finally used the tool provided by mmdet (by changing the number of output channels of the reg branch of the retinanet method), and updated the relevant content in the paper.

OK, I will try it. Thank you!


Update Get-TlsCipherSuite.md

Updated the language in the synopsis.
Updated the cmdlet's Name parameter description and noted that the comparison is case sensitive.
Noted that -Name AES is not the same as -Name aes are different.

Docs Build status updates of commit 98d4bd2:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/winserver2019-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2019-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Have accepted the suggestions - thanks

Docs Build status updates of commit d09d771:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/winserver2019-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2019-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Thank you @doctordns.
The same update should apply to W2016 and W2022.

How do I do that??

Thank you @doctordns.
The same update should apply to W2016 and W2022.

How do I do that??

find the articles for those versions in your own patch branch and make the edits there
https://github.com/doctordns/windows-powershell-docs/tree/patch-3

I think I have made all the changes to all three docs - and made them correctly and consistently.

Docs Build status updates of commit 411dfb3:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/winserver2019-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2019-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit 7a48547:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/winserver2016-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2016-ps)

docset/winserver2019-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2019-ps)

docset/winserver2022-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2022-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit 424ff53:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/winserver2016-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2016-ps)

docset/winserver2019-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2019-ps)

docset/winserver2022-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2022-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit 32e243e:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/winserver2016-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2016-ps)

docset/winserver2019-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2019-ps)

docset/winserver2022-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2022-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

@doctordns Thank you for this contribution and following up with the reviewers’ suggestions. The PR is good to go once the only remaining copy editing suggestion has been applied. Thanks.

Not sure where the 2022 came from - but accepted.
Looks like this is ready to go.

Docs Build status updates of commit c4dd1ce:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/winserver2016-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2016-ps)

docset/winserver2019-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2019-ps)

docset/winserver2022-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2022-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

Docs Build status updates of commit 24d3a22:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/winserver2016-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2016-ps)

docset/winserver2019-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2019-ps)

docset/winserver2022-ps/tls/Get-TlsCipherSuite.md
:white_check_mark:Succeeded
View (WindowsServer2022-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


chore: add server tests for dryrun query parameter

Description:
Add tests for the dryrun query parameter recently added to the /session/input-files and /session/verify-checked API endpoints.
Related issue(s):
Fixes #93

@acuarica  I do not see this issue when running the test several times (I do that interactively within IntelliJ).
These tests are supposed to be idempotent thanks to the beforeEach() clause of this module, which wipes out the repository ( rimraf.sync(server.repository) ). So we should be good.


Should terminal scroll position be restored?

Testing #186228
After reloading, should scroll position be restored? It isn't, but I don't know if that's the intended behavior.

This is intentional, I haven't heard anyone ask for it and it's a little complicated due to syncing to the pty host and the buffer cna change between connecting.


include xsd:type in field

I use this succesful project r2rml parser to generate rdf as from r2rml file and an oracle table.
The problem is that I generate rdf but without type specificatios...
In my r2rml I have this map for example:
rr:predicateObjectMap [
    rr:predicate gr:valueAddedTaxIncluded;
    rr:objectMap [
        rr:constant "true"; rr:datatype xsd:boolean;
    ];
];

But when I get the rdf file, the datatype boolean is not included:
http://example.com/Contract/66954/budgetPrice http://purl.org/goodrelations/v1#valueAddedTaxIncluded "true" .
it should be:
http://example.com/Contract/66954/budgetPrice http://purl.org/goodrelations/v1#valueAddedTaxIncluded "true" ^^xsd:boolean.
any help?

It seems that there is an issue with the Jena serializer to TURTLE.
Using your mapping and choosing the RDF/XML syntax (property jena.destinationFileSyntax in r2rml.properties), I have the result
  <rdf:Description rdf:about="...">
    <gr:valueAddedTaxIncluded rdf:datatype="http://www.w3.org/2001/XMLSchema#boolean">true</gr:valueAddedTaxIncluded>
  </rdf:Description>

but when I change the syntax to TURTLE (jena.destinationFileSyntax=TURTLE) the output is not correct.
What syntax do you use for the result model?

UPDATE: I read here
http://www.w3.org/TR/turtle/#booleans
that booleans are a special case.
So, in turtle syntax, the correct output is
http://example.com/Contract/66954/budgetPrice http://purl.org/goodrelations/v1#valueAddedTaxIncluded true

(without the quotes and the ^^xsd:boolean in the end).

But It is my understanding that I should include all the dataType for each field in the rdf file...
This are some of my r2rml.properties:
mapping.file.type=TURTLE
input.model.type=RDF/XML
jena.destinationFileSyntax=N3
Not only boolean but also float or datetime
Is it right?

Yes, you are right, the dataType should be included for each field in the rdf file. If no datatype is defined, the default is xsd:string.
My point is that with e.g. date, the serialization in turtle will be
ex:subject ex:prop "2015-05-01"^^xsd:date
and you have the type serialized explicitly: ^^xsd:date but with booleans, you will not have the ^^xsd:boolean at the end or the quotes around true.

Thanks nkons.
It there any option to include the datatype from the r2rml parser tool?

Not sure I understand the question. Could you please be more specific or give an example?

sorry nkons, I mean that if is it possible to include the datatype description into the rdf triples as it:
dump.rdf example:
https://servicios.aragon.es/rdf/Contract/66954/budgetPrice http://purl.org/goodrelations/v1#valueAddedTaxIncluded "true" ^^xsd:boolean.
https://servicios.aragon.es/rdf/Contract/66954/budgetPrice http://purl.org/goodrelations/v1#hasCurrencyValue "9643.72"^^xsd:float .

In Turtle syntax, no, datatype is not included explicitly in the output for boolean and float. However, the output is valid.
If you have to include the datatype, you will have to choose another serialization format for the output RDF graph, e.g. RDF/XML.
Now, for the other issue you mention, did you try to include in the R2RML mapping file a declaration rr:termType rr:IRI for this object map?

Thanks nkons, I know that include the dataType is not neccesary but it´s better anyway..
By the other hand, sometimes the generator includes the "<" and ">" for the uri in the object map but not always..It´s peculiar
I write it as rr:template:
rr:predicateObjectMap [
    rr:predicate pproc:procedureType;
    rr:objectMap [
        rr:template "http://contsem.unizar.es/def/sector-publico/pproc#{as_procedimiento}";
    ];
];

You will have to define the termType explicitly. I believe if you change it as follows it will work. If not, please let me know.
rr:objectMap [
         rr:template "https://example.com/Contract/{ID}/ContractActivities"; rr:termType rr:IRI;
];

Yes, it works nkons :)


How to pass Custom Java object to LiquidCore

Hi I have a class Person as:
`Person {
@JsonProperty("Name")
String name;
@JsonProperty("Age")
int age;
}`
I want to pass this into LiquidCore but i got exception unknown property 'Name' from underlying js function. But if i covert my 'Person' object into Map/HashMap using 'ObjectMapper' and then pass it to LiquidCore then it works fine but it has performance issues.
Please suggest any good way to pass Custom Java objects as well as List of to LiquidCore

The annotations are not well documented, but you can do it like this:
public class Person extends JSObject {
    @jsexport(type = String.class)
    Property<String> name;

    @jsexport(type = Integer.class)
    Property<Integer> age;

    Person(JSContext ctx, String name, Integer age) {
        super(ctx);
        this.name.set(name);
        this.age.set(age);
    }
};

Thanks for your reply.
How can i add it with @JsonProperty ? Actually I get response from Web Api then serial it with @JsonProperty
Can i do this?
`public class Person extends JSObject {
@jsexport(type = String.class)
@JsonProperty("Name")
Property name;
@jsexport(type = Integer.class)
Property<Integer> age;

Person(JSContext ctx, String name, Integer age) {
    super(ctx);
    this.name.set(name);
    this.age.set(age);
}

};`

I don't know much about @JsonProperty, but if it is a JSON object you want to pass to LiquidCore, you can use JSON.parse() like so:
String myJSONString = "..."; // I assume you can get this from ObjectMapper
JSValue person = JSON.parse(jsContext, myJSONString);

But I am not sure if this is any different than what you originally did, so it may have similar performance issues.

Wow, thanks JSON.parse(jsContext, myJSONString) really helps alot for me and boost performance


Resource "upstash_kafka_credential" returns wrong username as read-only output

We noticed that the "upstash_kafka_credential" resource returns a wrong value for the read only property "username". It does not match the username that can be found in the frontend UI (console.upstash.com).
Version: 1.2.5

Hello, @jalorenz
We are checking it. Thanks for the issue.

hey @jalorenz, we have fixed the issue, now both the ui and the terraform provider should showcase the same username.

@burak-upstash But no new version of the provider is required? 1.2.5 is still the current version

1.2.5 should work fine, yes. Just reapply, and you should be fine :) We did some changes on api level

main.tf:
resource "upstash_kafka_credential" "kafka-credentials" {
  cluster_id      = data.upstash_kafka_cluster_data.dev-cluster.cluster_id
  credential_name = "${var.deployment}-kafka-credentials"
  topic           = var.deployment == "dev" ? "dev-*" : "${var.deployment}-*"
  permissions     = "ALL"
}

outputs.tf:
output "upstash_kafka_username" {
  value = upstash_kafka_credential.kafka-credentials.username
}

Still produces another value than the UI

That is interesting. Can you try creating a dummy credential from scratch? I am suspecting since there is no change made on the configuration, it doesn't think it should re-fetch resource data from the api.
If the fresh one works, you can update your config or try -replace tag while applying

@burak-upstash Works, thanks


chore(*): bump spin and co crates per spin v3.0.0

Bump spin crates to v3.0.0
Bump spin trigger plugins (mqtt, sqs, command) to match
Bump wasmtime to match (22 -> 25)

I will do the release after merging this PR


Customizing number of epochs for training.

Hi, I have a quick question that how can I customize the number of epochs for training?

You can use --max-epoch to specify the number of epoches. Since Graphormer is based on Fairseq now, more training options can be found in FairSeq's DOC.

Thank you @GYHHAHA  for your timely reply.

Both --total-num-update and --max-epoch could be used for specifying training steps.


chore: Pinned down install script and added a reference to releases page

@MarshalX What do you think about that?
Now, we specify what the script requires and refer to the release page instead of using the install.sh script.

@MarshalX What do you think about that?
Now, we specify what the script requires and refer to the release page instead of using the install.sh script.

Hi, providing list of required deps is good 😌


messages: Dependency on activesupport via (ruby-protobuf / protobuf-cucumber)

Summary
My API application does not include any of the Rails gems for development or production.  However protobuf-cucumber has a dependency on activesupport and a very old version at that!
I totally understand why you moved away from google-protobuf (jruby support and latest RVM support) but I'd prefer not include activesupport...
Expected Behavior
Current Behavior
Possible Solution
Is it possible to revert back to google-protobuf and lock the RVM version to the latest supported?
Steps to Reproduce (for bugs)
Context & Motivation
Keeping my Gemfile.lock as small as possible
Your Environment

Sorry I mis-read this. Sorry mybad, it was in the correct repo to start with.


Crashing on nexus 5

I have installed this app and it always crashing on Nexus 5 and ads are not displaying.

Please share the logs relating to the crash..

Already reported via app.

That issue seems to be related to the OS (6.0) itself when Toast.makeText() is called & the app uses a direct reference for fontFamily in its theme instead of passing it as a String..
More Info here
I'll update / fix the Sample App soon..
& the Library works fine :)

Fixed in the latest commit ccf214cb5163302df50c25a10910d6babb810d90
Updated App is uploaded on the store, should be available in a few hours.


I am noticing lower validation accuracy on my dataset between Tensorflow 2.4 and Tensorflow 2.9

Click to expand!
Issue Type
Support
Have you reproduced the bug with TF nightly?
Yes
Source
source
Tensorflow Version
2.9 and 2.4
Custom Code
Yes
OS Platform and Distribution
Linux Ubuntu 20.04
Mobile device
No response
Python version
3.8
Bazel version
No response
GCC/Compiler version
No response
CUDA/cuDNN version
No response
GPU model and memory
No response
Current Behaviour?
I am trying to train an image classifier model using EfficientNetB1 on a custom dataset and I am trying out TensorFlow 2.4 and TensorFlow 2.9. I am using the exact same script with the same optimizer, augmentation, parameters, and dataset. I ran training 5 times and the results are around the same.
Results:

TensorFlow 2.4: ~97-98% Accuracy on the validation set.

TensorFlow 2.9: ~93-95% Accuracy on the validation set

More information: I am using Adam optimizer with 0.0001 lr, batch size of 16, using imagenet model weights, and categorical_crossentropy for my loss. I am using the same dataset on each version and I am using the same training script. I simply switch conda enviroments to TF 2.4 and 2.9.
Did something change between both versions that cause this discrepancy? Did the EfficientNet model weights change? Is the way the validation accuracy are calculated is different? Are the opimizers implementations are different?
I would appreciate your help and I would like some information on how to make it consistent between both versions. Thanks
Standalone code to reproduce the issue
import os
os.environ['CUDA_VISIBLE_DEVICES'] = '0'
os.environ['TF_FORCE_GPU_ALLOW_GROWTH'] = 'true'
import tensorflow as tf
from tensorflow.keras.applications import EfficientNetB1

model_base = EfficientNetB1(weights='imagenet',include_top=False, input_shape=(image_size, image_size, 3))
model.add(model_base)
model._name = "EfficientNetB1"
model.add(layers.Flatten())
model.add(tf.keras.layers.Dense(len(classes), activation='softmax'))

opt = Adam(learning_rate=1e-4)
model.compile(optimizer=opt, loss= 'categorical_crossentropy', metrics=['accuracy'])

Relevant log output
No response

@hlreicha,
I was facing a different issue while executing the given code. Kindly find the gist of it here.
Also there might be below chances for the low validation accuracy.
1. You are trying to apply some sort of preprocessing (zero meaning, normalizing, etc.) to either your training set or validation set, but not the other.
2. If you built some layers that perform differently during training and inference from scratch, your model might be incorrectly implemented (e.g. are moving mean and moving standard deviation for batch normalization getting updated during training?
If using dropout, are weights scaled properly during inference?). This might be the case if your code implements these things from scratch and does not use Tensorflow builtin functions.
3. Overfitting. I suspect that the other two options more likely in your specific situation as your validation accuracy might stuck at 50% for some epochs.
Using a random sample from your validation set: It means your validation set at each evaluation step is different, so is your validation-loss.
Using a weighted loss-function(which is used in case of highly imbalanced class-problems). At train step, you weigh your loss function based on class-weights, while at dev step you just calculate the un-weighted loss. In such case, though your network is stepping into convergence, you might see lots of fluctuations in validation loss after each train-step.

@tilakrayal
Hi, thank you for your response. I can post more functioning code block later if it would help. The problem is that I am not getting low validation (remember, I am in the 90% range), I am getting lower validation score with TensorFlow 2.9 compared to TensorFlow 2.4. The code (loading image, preprocessing, model building, and etc) is all the same, it is the matter of me switching conda enviroments.

I am not doing any preprocessing other than dividing the image by 255.0 and it is applied to both train/val sets. This never caused issues in TensorFlow 2.4
I am not using any custom layers, I import my EfficienetNet model, flatten it, and add the  final dense layer.
I have not experienced this behavior

I get these results after I ran my training script 5 times for each version.

TensorFlow 2.4: ~97-98% Accuracy on the validation set.

TensorFlow 2.9: ~93-95% Accuracy on the validation set

I should specify I set my random seed values as well. Did something change between both versions that causes EfficientNet to lose its performance?

@hlreicha - Would you be able to create a complete script / Colab using standard datasets, for example in tensorflow_datasets https://github.com/tensorflow/datasets to replicate this issue?


Fixed division by zero

When we have an array of alternatives as follows:
[
  [0, 1, 0]
  [0, 0, 1]
  [0, 1, 1]
]

All the alternatives have the value for criterion 1 set to 0.
This creates NaNs when normalizing criteria and scores when applying TOPSIS, VIKOR and WSM.
This pull requests fixes those divisions by zero.

Thanks @nicolasdeory


Move hasPreimage / getPreimage from Validator API to Full Node API

Related: https://github.com/bpfkorea/agora/issues/567
Currently hasPreimage (to be changed to getPreimage) is part of Validator's API.
It should be part of the full node API, as preimage need to be known to full node in order to verify signature (and it also increases data availability for them).

Edited

how can i start agora node loacally and preform transations. Is there any testnet fucet for this blockchain


Improve Custom Response Cards detection

In case a response card with an empty JSON in 'metadata' (e.g: { "metadata": {} } ) is sent by the operator it would be classified as a Custom Response Card even though it has no data in it. And as result would not display any 'options' only the message text and raw metadata as empty brackets
Jira issue:
No ticket.
Additional info:
Screenshots:
Was:

Became:

why my images do not load?

!squash

!merge


Memory Usage significant increase since 0.3.22

Bug Report
Description
Bug Summary:
When the version reaches or exceeds 0.3.22, memory usage will significantly increase from approximately 300MB to 600MB. This poses a substantial cost difference for serverless systems. I hope someone can identify the cause and resolve this issue.
Reproduction Details
Environment Varaible:

DATABASE_URL: postgresql://xxx
OPENAI_API_KEY: sk-xxx
RAG_EMBEDDING_ENGINE: openai
AUDIO_STT_ENGINE: openai
ENABLE_OLLAMA_API: false

Steps to Reproduce:
I deployed different versions of Open WebUI using Google Cloud Run and monitored the memory usage of each version. In version 0.3.21, the memory usage was around 300MB (with a set limit of 1GB)

Whereas when the version was upgraded to 0.3.22, the memory usage surged to approximately 600MB:

Try 0.3.30, that's the current latest.

I have tried, the memory usage still significant high.

I switch version from 0.3.22 to 0.3.30:

As you can see, the memory usage remains the same.


Added Network Console to experimental features

I also filed a PR for adding the screenshot I added to the Network Console section: https://github.com/MicrosoftDocs/edge-developer/pull/808

Docs Build status updates of commit 05259ed:
:warning: Validation status: warnings

File
Status
Preview URL
Details

microsoft-edge/devtools-guide-chromium/experimental-features.md
:warning:Warning

Details

microsoft-edge/devtools-guide-chromium/experimental-features.md

Line 98, Column 1: [Warning-file-not-found] Invalid file link: './media/network-network-console.png'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

To address @brendyna's feedback on What's New for Edge 85, I think the CORS limitations of Network Console should be called out here, not in What's New. @erdraud please include that as well.

Docs Build status updates of commit e1683f5:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/devtools-guide-chromium/experimental-features.md
:white_check_mark:Succeeded

microsoft-edge/devtools-guide-chromium/media/network-network-console.png
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 6959339:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/devtools-guide-chromium/experimental-features.md
:white_check_mark:Succeeded

microsoft-edge/devtools-guide-chromium/media/network-network-console.png
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit e10b21e:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/devtools-guide-chromium/experimental-features.md
:white_check_mark:Succeeded

microsoft-edge/devtools-guide-chromium/media/network-network-console.png
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 9143830:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/devtools-guide-chromium/experimental-features.md
:white_check_mark:Succeeded

microsoft-edge/devtools-guide-chromium/media/network-network-console.png
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 1a89bad:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

microsoft-edge/devtools-guide-chromium/experimental-features.md
:white_check_mark:Succeeded

microsoft-edge/devtools-guide-chromium/media/network-network-console.png
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

#sign-off offline and merged.


feat(): Added radiant-capital, aave-v2 fork on arbitrum

Based this one off of Geist fork. I only made the following changes to it:

Arbitrum contract calls are very slow, so rewards are calculated twice per day.
Reward token price USD is fetched from SushiSwap RDNT/WETH, and WETH price from the protocol oracle.
rToken (aToken) getAssetPrice() seems to return prices with 8 decimals, instead of 18.
Individually fetching lending and borrowing rewards. From our code, Geist seems to always give 3x the lender reward to the borrower. In radiant this is not the case, and the lender/borrower reward ratio is arbitrary on each pool.

Syncing here: https://okgraph.xyz/?q=QmcsfyCzhV5gfcWUzi4MJGbsJyxF4MU5FqoBhY1hxtuDKu

you should update deployment.json as well?


Discussion

Hey @sayakpaul, @MorganR,
I have few questions before I can start training the model:

LibriSpeech dataset is available in .flac format which can be read using tensorflow_io. But AFAIU cloud TPU's uses special build of TensorFlow and tensorflow_io is not working with that version. Is there any work around to this problem??
There are multiple variants of librispeech dataset- 100h, 360h, 500h (see this). 100h takes 6.3 GB, 360h takes 23 GB, 500h takes 30 GB disk space in compressed form. Best model in paper is obtained by training on combination of all datasets (i.e 960h). Which one dataset should I target for?? OR should I target 960h only (dataset will be quite large in uncompressed form) ??

Thanks!

I have used tensorflow_io with Cloud TPUs. Have you tried with an updated version on the TPU hardware? Also, if you could paste the error you are facing it'd be great. Also, how are you reading data while on TPUs?
Since we are aiming for SOTA models I think we should go for 500h at least. @MorganR what do you think?

@sayakpaul,
I am getting this error (when running python3 main.py for vg branch):
WARNING:tensorflow:AutoGraph could not transform <function decode_flac at 0x7f82400a6040> and will run it as-is.
Please report this to the TensorFlow team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output.
Cause: unable to open file: libtensorflow_io.so, from paths: ['/home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/libtensorflow_io.so']
caused by: ['libtensorflow_framework.so.2: cannot open shared object file: No such file or directory']
To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert
2021-06-26 14:48:16.704169: E tensorflow/core/framework/op_kernel.cc:1623] OpKernel ('op: "TpuHandleToProtoKey" device_type: "CPU"') for unknown op: TpuHandleToProtoKey
2021-06-26 14:48:16.704211: E tensorflow/core/framework/op_kernel.cc:1623] OpKernel ('op: "TPURoundRobin" device_type: "CPU"') for unknown op: TPURoundRobin
2021-06-26 14:48:16.904596: E tensorflow/core/framework/op_kernel.cc:1623] OpKernel ('op: "TpuHandleToProtoKey" device_type: "CPU"') for unknown op: TpuHandleToProtoKey
2021-06-26 14:48:16.904651: E tensorflow/core/framework/op_kernel.cc:1623] OpKernel ('op: "TPURoundRobin" device_type: "CPU"') for unknown op: TPURoundRobin
Traceback (most recent call last):
  File "main.py", line 135, in <module>
    main(args, resolver)
  File "main.py", line 70, in main
    tr_dataset = LibriSpeechDataLoader(tr_data_args)(seed=args.seed)
  File "/home/vasudevgupta/gsoc-wav2vec2/src/data_utils.py", line 43, in __call__
    dataset = self._build_and_fetch_dataset()
  File "/home/vasudevgupta/gsoc-wav2vec2/src/data_utils.py", line 96, in _build_and_fetch_dataset
    input_dataset = input_dataset.map(
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/data/ops/dataset_ops.py", line 1861, in map
    return ParallelMapDataset(
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/data/ops/dataset_ops.py", line 4733, in __init__
    self._map_func = StructuredFunctionWrapper(
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/data/ops/dataset_ops.py", line 3923, in __init__
    self._function = fn_factory()
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 3143, in get_concrete_function
    graph_function = self._get_concrete_function_garbage_collected(
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 3109, in _get_concrete_function_garbage_collected
    graph_function, _ = self._maybe_define_function(args, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 3456, in _maybe_define_function
    graph_function = self._create_graph_function(args, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 3291, in _create_graph_function
    func_graph_module.func_graph_from_py_func(
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/func_graph.py", line 1007, in func_graph_from_py_func
    func_outputs = python_func(*func_args, **func_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/data/ops/dataset_ops.py", line 3898, in wrapped_fn
    ret = wrapper_helper(*args)
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/data/ops/dataset_ops.py", line 3828, in wrapper_helper
    ret = autograph.tf_convert(self._func, ag_ctx)(*nested_args)
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py", line 695, in wrapper
    raise e.ag_error_metadata.to_exception(e)
NotImplementedError: in user code:

    /home/vasudevgupta/gsoc-wav2vec2/src/data_utils.py:106 decode_sound  *
        audio = tfio.audio.decode_flac(audio, dtype=tf.int16)
    /home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/audio_ops.py:480 decode_flac  **
        return core_ops.io_audio_decode_flac(input, shape=shape, dtype=dtype, name=name)
    /home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/__init__.py:88 __getattr__
        return getattr(self._load(), attrb)
    /home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/__init__.py:84 _load
        self._mod = _load_library(self._library)
    /home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/__init__.py:69 _load_library
        raise NotImplementedError(

    NotImplementedError: unable to open file: libtensorflow_io.so, from paths: ['/home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/libtensorflow_io.so']
    caused by: ['libtensorflow_framework.so.2: cannot open shared object file: No such file or directory']

Traceback (most recent call last):
  File "main.py", line 135, in <module>
    main(args, resolver)
  File "main.py", line 70, in main
    tr_dataset = LibriSpeechDataLoader(tr_data_args)(seed=args.seed)
  File "/home/vasudevgupta/gsoc-wav2vec2/src/data_utils.py", line 43, in __call__
    dataset = self._build_and_fetch_dataset()
  File "/home/vasudevgupta/gsoc-wav2vec2/src/data_utils.py", line 96, in _build_and_fetch_dataset
    input_dataset = input_dataset.map(
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/data/ops/dataset_ops.py", line 1861, in map
    return ParallelMapDataset(
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/data/ops/dataset_ops.py", line 4733, in __init__
    self._map_func = StructuredFunctionWrapper(
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/data/ops/dataset_ops.py", line 3923, in __init__
    self._function = fn_factory()
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 3143, in get_concrete_function
    graph_function = self._get_concrete_function_garbage_collected(
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 3109, in _get_concrete_function_garbage_collected
    graph_function, _ = self._maybe_define_function(args, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 3456, in _maybe_define_function
    graph_function = self._create_graph_function(args, kwargs)
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 3291, in _create_graph_function
    func_graph_module.func_graph_from_py_func(
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/func_graph.py", line 1007, in func_graph_from_py_func
    func_outputs = python_func(*func_args, **func_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/data/ops/dataset_ops.py", line 3898, in wrapped_fn
    ret = wrapper_helper(*args)
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/data/ops/dataset_ops.py", line 3828, in wrapper_helper
    ret = autograph.tf_convert(self._func, ag_ctx)(*nested_args)
  File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py", line 695, in wrapper
    raise e.ag_error_metadata.to_exception(e)
NotImplementedError: in user code:

    /home/vasudevgupta/gsoc-wav2vec2/src/data_utils.py:106 decode_sound  *
        audio = tfio.audio.decode_flac(audio, dtype=tf.int16)
    /home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/audio_ops.py:480 decode_flac  **
        return core_ops.io_audio_decode_flac(input, shape=shape, dtype=dtype, name=name)
    /home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/__init__.py:88 __getattr__
        return getattr(self._load(), attrb)
    /home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/__init__.py:84 _load
        self._mod = _load_library(self._library)
    /home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/__init__.py:69 _load_library
        raise NotImplementedError(

    NotImplementedError: unable to open file: libtensorflow_io.so, from paths: ['/home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/libtensorflow_io.so']
    caused by: ['libtensorflow_framework.so.2: cannot open shared object file: No such file or directory']

After this error message, if I install tensorflow_io again with pip3 install tensorflow_io , it is able to load file but I loss access to TPUs.
I am using new cloud TPUs in which we can directly SSH (gcloud alpha compute tpus tpu-vm). I am loading data directly as specified in my LibriSpeechDataLoader.

NotImplementedError: unable to open file: libtensorflow_io.so, from paths: ['/home/vasudevgupta/.local/lib/python3.8/site-packages/tensorflow_io/python/ops/libtensorflow_io.so']
caused by: ['libtensorflow_framework.so.2: cannot open shared object file: No such file or directory']

This is the root cause. TPUs cannot read from your local filesystem.  Follow these guidelines to quickly set up an AI Platform Notebook instance (attached to a TPU). That way you can a cheap VM that has TPU attached, a terminal, and everything else that you may need.
If you use that script, be sure to verify its arguments and modify it so that it installs the latest TensorFlow version. Let me know if anything is unclear.

Thanks for reply.
A small follow up question: Does this hold for alpha-TPUs (which can be used just like GPUs) as well (like earlier I trained some model just like I am doing now & it worked for me)?? (Again I have never used normal version of TPUs before so not sure if I asking a relevant question).

Good question. This probably has to do with compatibility issues of TPUs and large datasets that do not fit in memory. What dataset did you use to test-drive the alpha TPU VMs? Could you also comment on its size?
On the contrary, I haven't tried them out yet.

I have used natural-questions dataset (~100 GB size). Though that project was in flax so may be tensorflow, i need to load from gcs only.

Likely. If you have already used a 100 GB dataset then I would like us to consider the 960h version of the dataset for this project. @MorganR what do you think?

I have converted the dataset in .tfrecords format & its working. So, 1st issue is resolved.

Using 960h sounds like the best option if it's feasible. Vasudev, please
share if you run into more issues and we'll try to help where possible.
On Sun, Jun 27, 2021 at 12:38 AM Vasudev Gupta @.***>
wrote:

I have converted the dataset in .tfrecords format & its working. So, 1st
issue is resolved.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/vasudevgupta7/gsoc-wav2vec2/issues/3#issuecomment-869069839,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABZIOLDK5224KTPTJEH6JHLTUZJHVANCNFSM47LLV5CQ
.

Thanks!!
Yes, working on 960h now.


:robot: Triggering CI on branch 'release-next' after synching to upstream/main

No clusters in pool are ready to be claimed
/retest

/test 412-test-conformance-aws-412


fix bug in diff generator

Fixes a bug in diff generator, where the same line is repeated 2 times.
Example:

You can see that #0 main is repeated 2 times, similarly Breakpoint 1.
This PR fixes it.

Fixes a bug in diff generator, where the same line is repeated 2 times.
Example:
You can see that #0 main is repeated 2 times, similarly Breakpoint 1.
This PR fixes it.

There are differences in #0 main lines and the Breakpoint 1 lines also. Aren't they supposed to appear just the way they appear? Maybe I am missing something...

https://github.com/user-attachments/assets/c8f62535-ae07-4955-942b-4dcbf3ab41d8
Please have a look at the video. Hope this makes things clear.


[main] Upgrade to latest dependencies

Cron -knative-prow-robot
/cc knative/operations-wg-leads
/assign knative/operations-wg-leads
Produced by: knative-sandbox/knobots/actions/update-deps
Details:
bumping knative.dev/caching 03ca91f...e3ddad5:
  > e3ddad5 Format markdown (# 639)
bumping knative.dev/serving 4e54509...45f7c05:
  > 45f7c05 Fix deprecation notices (# 12958)
  > 4446497 fix owner files after merging scaling + serving working groups (# 12960)
  > 92b11a8 drop swap file (# 12959)
  > 591e12d upgrade to latest dependencies (# 12954)
  > a522443 Update net-istio nightly (# 12951)
  > 9ea835d Update net-gateway-api nightly (# 12950)
  > bc7fcd3 Update net-certmanager nightly (# 12949)
  > b2fff20 Update net-contour nightly (# 12948)
  > 9db81c3 Update net-kourier nightly (# 12952)

/test eventing-upgrade-tests_operator_main
/lgtm
/approve


[WFLY-13267] Convert EJB3 subsystem transformers to use chained transformers

This PR does the following:

adds in transformer tests for the ejb3 subsystem for EAP versions 7.0.0, 7.1.0 and 7.2.0
refactors the transformers to use the chained transformer approach, to simplify understanding of the transformers and make maintenance easier

For more details, see: https://issues.redhat.com/browse/WFLY-13267

Hi @pferraro , any feedback on how to improve this would be appreciated. In other words, waiting on review.

I think there is a problem here with overwriting changes from WFLY-13015, fixing them now.

This is going to take a while; now my tests are failing because of the changes to DiscardAttributeChecker.DEFAULT replacing the original default values. I've got to go through and check each change...

I removed the "Ready for merge" based on the last couple comments.

It's ready now...I just missed a couple of places where Pauls previous commit got reverted by my commit during the merge


make it so that the "stacktrace" is provided (so that we can see paths)

renamed to ref_trace, and implemented.


toil(repo): add tildebyte as owner of installer/ directory

No review needed unless #1365 is merged


Support --install-globally for daemon mode

Hi,
Would it be possible to use --install-globally parameter for the trains-agent daemon mode?
Currently, this parameter is only available for the trains-agent build mode.

Hi @H4dr1en ,
You can already configure it in the trains.conf file (see here), which will also work in virtual-env mode.
You mean to actually add the --install-globally to the CLI interface?


Adds Komondor, SwiftLint and SwiftFormat

This adds, and automates using SwiftLint and SwiftFormat via Komondor.
So the diff is pretty big, I'll highlight the stuff I actually did.

Warnings

:warning:
 Any changes to library code should be reflected in the Changelog.
Please consider adding a note there and adhere to the Changelog Guidelines.

  Generated by :no_entry_sign: dangerJS

Merging from master helped. I'm gonna keep the // dev because it makes the script very simple, and easy to copy to other projects, I think it's a good idea though if it weren't a one-off