[BUG] PayloadTooLargeError: request entity too large

Describe the bug
Loading in a 48M PDF file is producing the following error:
Failed to save chatflow:     Error   PayloadTooLargeError: request entity too large    at readStream (/home/kristian/.nvm/versions/node/v18.12.1/lib/node_modules/flowise/node_modules/raw-body/index.js:156:17)    at getRawBody (/home/Kristian/.nvm/versions/node/v18.12.1/lib/node_modules/flowise/node_modules/raw-body/index.js:109:12)    at read (/home/Kristian/.nvm/versions/node/v18.12.1/lib/node_modules/flowise/node_modules/body-parser/lib/read.js:79:3)    at jsonParser (/home/Kristian/.nvm/versions/node/v18.12.1/lib/node_modules/flowise/node_modules/body-parser/lib/types/json.js:135:5)    at Layer.handle [as handle_request] (/home/Kristian/.nvm/versions/node/v18.12.1/lib/node_modules/flowise/node_modules/express/lib/router/layer.js:95:5)    at trim_prefix (/home/Kristian/.nvm/versions/node/v18.12.1/lib/node_modules/flowise/node_modules/express/lib/router/index.js:328:13)    at /home/Kristian/.nvm/versions/node/v18.12.1/lib/node_modules/flowise/node_modules/express/lib/router/index.js:286:9    at Function.process_params (/home/Kristian/.nvm/versions/node/v18.12.1/lib/node_modules/flowise/node_modules/express/lib/router/index.js:346:12)    at next (/home/Kristian/.nvm/versions/node/v18.12.1/lib/node_modules/flowise/node_modules/express/lib/router/index.js:280:10)    at expressInit (/home/Kristian/.nvm/versions/node/v18.12.1/lib/node_modules/flowise/node_modules/express/lib/middleware/init.js:40:5)
To Reproduce
Steps to reproduce the behavior:
Use PDF file to load the PDF, when clicking save on the flow the error is produced.
Expected behavior
I expected the document to be loaded for use by the flow.
Screenshots

Additional context
Add any other context about the problem here.

Can you try increase the size to 100mb here:
https://github.com/FlowiseAI/Flowise/blob/main/packages/server/src/index.ts#L66
and
https://github.com/FlowiseAI/Flowise/blob/main/packages/server/src/index.ts#L67

That resolved the problem. So not really a "bug" but a configuration. Closing.

Hello @kristianjackson Im getting same error, can you write me down how did you fix it? How can i increase limits? Thanks.

Same here.

I have this issue right now, I have a exported DB file larger than 50MB, and now it won't import again.
Where can the limit be set, I can only see it hard coded.

I have added 9 PDF File components. Total pdf files is 138mb
I changed this in the index.js file
my local install
C:\Users\User\node_modules\flowise\dist
async config(socketIO) {
// Limit is needed to allow sending/receiving base64 encoded string
this.app.use(express_1.default.json({ limit: '150mb' }));
this.app.use(express_1.default.urlencoded({ limit: '150mb', extended: true }));
I still get this error after restarting flowise.
Failed to save chatflow:     Error   PayloadTooLargeError: request entity too large    at readStream (C:\Users\User\node_modules\raw-body\index.js:156:17)    at getRawBody (C:\Users\User\node_modules\raw-body\index.js:109:12)    at read (C:\Users\User\node_modules\body-parser\lib\read.js:79:3)    at jsonParser (C:\Users\User\node_modules\body-parser\lib\types\json.js:135:5)    at Layer.handle [as handle_request] (C:\Users\User\node_modules\express\lib\router\layer.js:95:5)    at trim_prefix (C:\Users\User\node_modules\express\lib\router\index.js:328:13)    at C:\Users\User\node_modules\express\lib\router\index.js:286:9    at Function.process_params (C:\Users\User\node_modules\express\lib\router\index.js:346:12)    at next (C:\Users\User\node_modules\express\lib\router\index.js:280:10)    at expressInit (C:\Users\User\node_modules\express\lib\middleware\init.js:40:5)
Any ideas.
Or a different approach ? The project is regulation documents spread over 9 PDF files.

I had to lose the project as it would not save.
I added the merged pdf file 138 mb to another project and it saved ok.
So I presume the above settings are correct. ( Can anyone from admin confirm this )

adding  FLOWISE_FILE_SIZE_LIMIT =  200mb
the same error, someone findout the fix pls?


Documentation

Hey Jason - Any chance you're still working on this project? We'd love to utilize it if / when you put together some documentation.
Thanks,
Eric

Hey Eric. Sorry I just threw this up here with no documentation. I plan to improve it as I have time but I'm a lil swamped at the moment. I really just needed it for a simple use case in one of my projects so I don't have a pressing need to work on it right at the moment. I'm happy to answer any questions you might have on it though. And PRs are certainly welcomed :smiley:.

Hey Jason - no sweat. We’re actually taking a different route (Basic URL Builder) to track this type of stuff and won’t be using the FB pixel. Seems that’s a more effective route for us. Thanks though!
On Nov 5, 2015, at 4:33 PM, Jason Kriss<EMAIL_ADDRESS>wrote:
Hey Eric. Sorry I just threw this up here with no documentation. I plan to improve it as I have time but I'm a lil swamped at the moment. I really just needed it for a simple use case in one of my projects so I don't have a pressing need to work on it right at the moment. I'm happy to answer any questions you might have on it though. And PRs are certainly welcomed .
—
Reply to this email directly or view it on GitHub https://github.com/jasonkriss/ember-facebook-pixel/issues/1#issuecomment-154230911.

For sure. Thanks @ehubbell. Gonna leave this issue open for now as it needs documentation regardless.


species not appearing in the species tab

The Species Tab on obs search is capped at 500 species, but in some situations, a taxon that should appear there does not. Here's one:
https://www.inaturalist.org/observations?nelat=35.97800618085566&nelng=-92.098388671875&place_id=any&swlat=25.621715959845755&swlng=-103.656005859375&taxon_id=47208&view=species
If you look at https://www.inaturalist.org/observations?nelat=35.97800618085566&nelng=-92.098388671875&place_id=any&swlat=25.621715959845755&swlng=-103.656005859375&taxon_id=311038&view=species, you'll see that Anomoea rufifrons has 9 obs and should be on that list.

I think this is fixed in inaturalist/iNaturalistAPI@eabca83


Implement SQL statements Prepare, Execute and Deallocate

The Postgres doc: https://www.postgresql.org/docs/current/sql-prepare.html#SQL-PREPARE-EXAMPLES .
The crate sqlparser-rs needs to be upgraded to include the PR: https://github.com/ballista-compute/sqlparser-rs/pull/243 .
These three statements should be considered as one part of Prepared Statement (another one is Extended Query), and should be implemented and integrated with the current implementation of Prepared Statement (in session).
It is used for Prepared Statement. Please reference more information in PR #274 .

Hi @alex-dukhno , please assign this issue to me.
I could continue integrating these SQL statements with existing Prepared Statement feature.


Please consider fixing issues detected by repository checker

Notification from ioBroker Check and Service Bot
Dear adapter developer,
I'm the ioBroker Check and Service Bot. I'm an automated tool processing routine tasks for the ioBroker infrastructure. I have recently checked the repository for your adapter myvbus for common errors and appropiate suggestions to keep this adapter up to date.
This check is based the current head revisions (master / main  branch) of the adapter repository
Please see the result of the check below.
ioBroker.myvbus
   -
:thumbsup: No errors found
WARNINGS:

[ ] :eyes: [W034] @iobroker/adapter-core 3.2.1 specified. 3.2.2 is recommended. Please consider updating dependencies at package.json

:thumbsup: No suggestions found
Please review issues reported and consider fixing them as soon as appropiate.
Warnings reported by repository checker should be reviewed. While some warnings can be ignored due to good reasons or a dedicated decision of the developer, most warnings should be fixed as soon as appropiate.
You may start a new check or force the creation of a new issue at any time by adding the following comment to this issue:
@iobroker-bot recheck
or
@iobroker-bot recreate
Please note that I (and the server at GitHub) have always plenty of work to do. So it may last up to 30 minutes until you see a reaction. I will drop a comment here as soon as I start processing.
Feel free to contact me (@iobroker-bot) if you have any questions or feel that an issue is incorrectly flagged.
And THANKS A LOT for maintaining this adapter from me and all users.
Let's work together for the best user experience.
your
ioBroker Check and Service Bot
@mcm1957 for evidence
Last update at Fri, 01 Nov 2024 04:43:04 GMT based on commit 5c3a4e0035308fefe356a21a81715293090fa654
ioBroker.repochecker 3.1.4

@iobroker-bot recheck

@ioBroker-Bot recheck


Job fails because of time out

When I run my cwl workflow, the job fails with the following error:
2018-Jul-03 10:55:16.620 ERROR - Exception during execution
nl.esciencecenter.xenon.adaptors.schedulers.JobCanceledException: local adaptor: Process timed out.
	at nl.esciencecenter.xenon.adaptors.schedulers.JobExecutor.run(JobExecutor.java:371)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2018-Jul-03 10:55:16.627 ERROR - Error during execution of Analyze Fiqh latest version(56886295-a16b-46a8-8e7f-376d90ce1fcf)
nl.esciencecenter.xenon.adaptors.schedulers.JobCanceledException: local adaptor: Process timed out.
	at nl.esciencecenter.xenon.adaptors.schedulers.JobExecutor.run(JobExecutor.java:371)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2018-Jul-03 10:55:16.653 INFO - Job 56886295-a16b-46a8-8e7f-376d90ce1fcf now has state: Permanent_Failure

I don't see any errors or other worrying output in the stderr of the job.
Is there a default time out in Xenon, and is there a way to configure it in xenon-flow to prevent this from happening? Or is there a different cause of this exception?

This exception is the result of the process running longer than was specified in the JobDescription. The default is 15 minutes at the moment. Setting the maxRuntime to 0 will give you "infinite time".
Is this something you can specify in your workflow, or does xenon-flow simply use the default?

It seems I just use the default.
The cwl specification allows for hinting: https://www.commonwl.org/v1.0/CommandLineTool.html#Execution, so I think this may be a good place to implement this.
Then the default could go to 0 and the hint can change that.
@jmaassen are there systems / adaptors that require a non 0 maxRuntime?

Yes, system admins can configure the batch scheduler to require a set max runtime.

IMHO it should be a ResourceRequirement, see also https://github.com/common-workflow-language/common-workflow-language/issues/590, but it's going to be a TimeLimit in CWL 1.1 apparently.

@bpmweel I think I have never used a cluster that did not require a max runtime of a job to be specified, or alternatively, that would default to a relatively short value (like 15 minutes or 1 hour) if you did not specify anything. Some sites also have an upper limit. At Cartesius it is 5 days for example, but I've also used supers that had a 24 hour limit.
The default of xenon is arbitrarily chosen to have the same value as the DAS ;-) We can set it so something else, but setting it to 0 will not always work because some clusters require you to set a value.
In the end the user will have to think about what run time would be acceptable. This is not something we can determine automatically.

As a first step I have implemented a new config option for ComputeResource that allows you to override the default Xenon maxRunTime.
it is maxTime and expects an integer representing the maximum time (and thus the time reserved on the compute resource) in minutes
ComputeResources:
     local:
        maxTime: 20
        cwlCommand: /some/path/to/a/cwl/runner
        scheduler:
            adaptor: local
            location: /some/path/where/to/run/locally


Doesn't work out of the gate

Not sure what I'm doing wrong, but I'd really love to get this fixed after following the README pretty exact I think.
serializers.py
from rest_flex_fields import FlexFieldsModelSerializer

class CastleSerializer(FlexFieldsModelSerializer):
    class Meta:
        model = Castle
        fields = '__all__'

class RoomSerializer(FlexFieldsModelSerializer):
    castle = serializers.PrimaryKeyRelatedField(read_only=True)

    class Meta:
        model = Room
        fields = ('id', 'name', 'castle')

        expandable_fields = {
            "castle": CastleSerializer
        }

settings.py
# To make our nested serializers more like JSON API
REST_FLEX_FIELDS = {"EXPAND_PARAM": "include"}

API call: GET /api/v1/room/1/?include=castle
or
API call: GET /api/v1/rooms/?include=castle
both give:
{
    "id": 1,
    "name": "Throne Room",
    "castle": 1
}

OR

[
  {
    "id": 1,
    "name": "Throne Room",
    "castle": 1
  }
]

I expect it to be:
{
    "id": 1,
    "name": "Throne Room",
    "castle": {
        "id": 1,
        "name": "Daventry Castle"
    }
}

I also expect to be able to POST an update method without having to add the nested castle id and have it just validate and work. That looks like it's fixed in the latest.
API call: POST /api/v1/rooms-update/
{
    "id": 1,
    "name": "Throne Room Changed Text",
}

TO RETURN

{
    "id": 1,
    "name": "Throne Room Changed Text",
    "castle": {
        "id": 1,
        "name": "Daventry Castle"
    }
}

It seems none of this is currently working. What am I missing out there (probably obvious to everyone else) to get this library working?

I switched to django-restql to get the functionality I needed. Sorry for the long entry!


Problems around 'smoothscroll'

Steps to reproduce

vim --clean
:set lines=20 columns=80 smoothscroll
:call setline(1, repeat([''], 100))
Hit G
See the cursor is at the middle of the window, not the bottom, and EOB lines are shown. It is inconsistent with the usual behavior of G
:call setline(82, repeat('a', 100))
Hit <C-B>G
See the cursor is misplaced at the command line

Expected behaviour
Cursor is at the bottom of the window at step 5 and 8.
At step 8., next thing is shown at the top of the screen:
<<<aaaaaaaaaaaaaaaaa

Version of Vim
9.0.1428
Environment
OS: Windows / Ubuntu (WSL)
Terminal: Windows Terminal / GUI
Logs and stack traces
No response

I confirmed that this seems to be caused by #11764, which itself was to fix some issues with smoothscroll but I guess may have introduced some subtle bugs as well. I could take a look.


Fix failing eden tests

Multiple patches in this PR:

Increased the default EVE version to the latest 12.4
Removed workflow dependency on Smoke test suite. With reusable workflows this does not work properly in the EVE repository. The other test suites are triggered regardless of the outcome of Smoke tests. The only effect this dependency has, is that other workflows are delayed from starting until Smoke tests finish, increasing the total execution time of all tests.
Moved tests that depend on virtualization (apps must be deployed inside VMs) to a separate test suite. The primary reason is that the HW-assisted nested virtualization is performing poorly on the buildjet runners and we are getting many failures (not related to EVE code). For every other test it is therefore better to run EVE with acceleration disabled. A secondary reason is that most of these tests are from the networking test suite, which is already quite long and takes well over an hour to execute. It therefore makes sense to move some tests to a different test suite. Please note that when the Virtualization test suite is run locally, all tests are passing. However, on buildjet runners they are expected to fail until we resolve the issue with the nested virtualization.
Fixed 'eden pod modify' (wrong timeout + app state to wait for had to be modified to reflect recent EVE changes)
Fixed ctrl_cert_change test (improper use of -check-new)
App 'nodered' needs more time to get deployed
Test publish_location is now skipped and likely will be removed. This is because after the recent changes in the EVE/wwan microservice, injecting a fake GPS location data is no longer possible.
Modified EVE-upgrade tests to use newer base EVE version (> 12.0). This is because the policy_version of fscrypt was bumped from 1 to 2 and this change is not backward compatible. Meaning we cannot downgrade from 12.X to 11.Y or older.

Please note that we are still getting some occasional kernel crashes on buildjet runners (even with accel=false), so even stable tests may fail once in a while.

Forgot the sticker :D :shipit:
And also I see that LPC LOC tests are failing, right?

Forgot the sticker :D :shipit:
And also I see that LPC LOC tests are failing, right?
Edit: and some of the Smoke tests are still failing and they fail on rebooting. I wonder if it has to do with Buildet runners as well

Yes, all of those were due to kernel crashes that we are occasionally getting.

Runners are without Internet connectivity, will try again tomorrow...

Kernel crashes are quite often.
I wonder if the "noisy neighbor" (quoting the guy from Buildjet) is actually us and these problems are more frequent when we run many eden workflows at the same time (likely scheduled on the same host(s)).

Okay, anyways I'm merging this PR and telemetry one, let's try to get as much info as possible

Let's try to run it on local runner, get statistics from it and compare them


Drop iOS 8 target and remove AssetsLibrary dependency

Closes #20

Anyone can confirm and merge this PR? Thanks.

I made a commit that dropped iOS8 support completed: https://github.com/zhangao0086/DKPhotoGallery/commit/6a7164ab69319d6e04e321a419a2924f8b7d0fff
@zummenix Thanks for your effort!


camerad: abstract cameras

resolve https://github.com/commaai/openpilot/issues/25718

Need to merge https://github.com/commaai/openpilot/pull/25720 first to Initialize and open camera in AbstractCamera

All camera-related parameters and functions have been moved to separate files. there is no if CAMERA_ID_AR0231 else in qcom2 anymore

Nice, this looks pretty good. Now that VisionIPC has been abstracted out of camerad, we've decided that camerad should just be a highly optimized camera driver for the comma three, so feel free to do any relevant cleanups. I'd also like to better separate the 845-releated code and the image sensor related code (AR0321 and OX03C10).

ok, i will split it into small PRs and do it incrementally

Nice, I like breaking things up like this! Want to take over "refactor sensor parameters to struct"?

Already looking a lot nicer!

@deanlee good to close this? I'm pretty happy with all the sensor abstractions now

y


Java backend engine bugfix: Resetting constraint at the beginning of each step

Otherwise stale constraint from a previous operation might be present.
Previously this lead to function rules being evaluated in the context of another branch. This could cause false specs getting proved, or the other way around, in the presence of branching.

VSC passes: https://github.com/runtimeverification/verified-smart-contracts/pull/214
(look on Jenkins page for details)

@daejunpark can you approve this one? It looks good to me, but I'm less confident about the proving code and would like one more set of eyes on it. Otherwise, looks good to me.

Thanks for the fix! :)


styleguide.html fails W3C check in styleguide_icons section

Existing HTML in the Icons section of the Styleguide throws a "closing tag matches nothing" error on a W3C validity check.
Existing code example

Potential solution example

As part of our move to #674, which just landed, the legacy styleguide has now been dropped. We are no longer supporting that particular component of WSK.


Ensure the test name is stable across executions

Summary
When executing ConfigurationCacheGradlePropertiesIntegrationTest#passing cli... methods, we would see flaky errors coming from the test-retry plugin saying that some methods could not be retried (failures). The method name contains the String representation of objects returned by the specs() method. Since the ordering of these elements is not stable, the same method may have a different name on rerun (see screenshot from the GE Tests dashboard). Because the class is retried as a whole (TBD why exactly that happens), all iterations will be repeated, the specs() method will be called again and failed methods will have a different name. The retry plugin relies on the stable method names to confirm that retries were successful.
There are multiple ways to fix the problem. I decided to ensure that the order of Spec objects is stable and such error does not occur in other classes if the fixture is re-used.
Fixes https://github.com/gradle/gradle-private/issues/3859

@bot-gradle test this

I've triggered the following builds for you:

PullRequestFeedback build

@gradle/bt-configuration-cache , are you aware of any configuration that causes this class to be retried as a whole instead of its individual methods? I've looked for usages of retry.classRetry, @Stepwise or @ClassRetry which are the recommended ways to configure this behaviour, but could not find anything. I'll continue looking into it myself, but maybe you'd know immediately what's up.

@bot-gradle test and merge

I've triggered a build for you. Click here to see all failures if there's any.

Pre-tested commit build failed.

@bot-gradle test and merge

Your PR is queued. See the queue page for details.

I've triggered a build for you. Click here to see all failures if there's any.


Promote Pod Disruption Budgets to GA

PR to update documentation after PDBs have been promoted to GA.
KEP: https://github.com/kubernetes/enhancements/blob/master/keps/sig-apps/85-Graduate-PDB-to-Stable/README.md
Issue: https://github.com/kubernetes/enhancements/issues/85
PR: https://github.com/kubernetes/kubernetes/pull/99290

/assign
/sig apps

/remove-language es ja ko zh

@sftim I have removed the changes to any other languages than English and updated the PR based on your suggestions.

Hi @mortent , thank you for having your Doc PR ready for review, here are upcoming doc related dates for the 1.21 release:
Upcoming doc related dates for the 1.21 release:

 Docs Ready for Review deadline is March 24
Docs Ready to Merge deadline is March 31

@kubernetes/sig-apps-pr-reviews  , please provide a technical review for this PR by March 31 to get this into the release. Thank you!

/approve

/lgtm

/approve

/hold cancel


Segmentation fault (core dumped)

Hi,
I'm in the process of switching from CC to QC. Right now, I'm trying to match past CC self-calibration to check that I'm getting similar image fidelity/improvement.
 Oddly, these seem to be stochastic; i.e., sometimes the command will execute fully, but most of the time, it will kill the script. QC should have no problems running this script as I could run it in CC (on the same machine) without issues (the only difference is I've changed the f-slope solver to delay_and_offset).
I'm not exactly sure what information/documents would help debug this issue, but if you let me know what you need to reproduce the error, I can provide it.
(Virtual) Machine specs:
64 Gb, 8 core
Data:
S-band VLA data (i.e., 2 x 8 SPW basebands, each with 512 -- 2 MHz -- channels)

Hi @AKHughes1994! Sorry that you seem to have run into a bug - if it seems stochastic it may be thread safety related. Could you please share both your log file and your QuartiCal config file/command line?

Hi @JSKenyon I've attached the log file + .yaml file,
The command I run is,
goquartical ../quartical_parsets/DI_bb.yaml input_ms.path=ms.ms input_ms.select_ddids=[8,9,10,11,12,13,14,15] input_ms.freq_chunk=512 K.freq_interval=512
DI_bb.txt
20230829_194411.log.qc.txt

Ok, I can reproduce on an arbitrary dataset which suggests it is a bug in the code and not some peculiarity in the data. Will drill down and find it.

I believe I have found the problem - could you please unset output.subtract_directions? Please let me know if that works for you, as it seems to resolve the segfaults (due to out of bounds access) for me.
Thanks for the bug report - I will put in a check to ensure this doesn't trouble anyone else.

Ahhhhh!
I modified a DD yaml file into a DI yaml file and absolutely should have caught that issue. Apologies.
Thanks for finding it,
Andrew


Issue #50

isPlural and isSingular functions added

Coverage remained the same at 100.0% when pulling 55637a2b9ede93aaef2f93b6155817bb547e35ee on petekeller2:master into fe83cec4fb6b174ff04f6d0159244fcc6a180b8e on blakeembrey:master.

Coverage remained the same at 100.0% when pulling f718493a81c24d5856c4c4bed2be5c80863613b7 on petekeller2:master into fe83cec4fb6b174ff04f6d0159244fcc6a180b8e on blakeembrey:master.

There's probably a more performant way to write this if it's going to be implemented in the library itself. Should be easy to alter replaceWord to instead return true or false - no need to do some steps if we're just doing detection. If you're willing to do that, feel free - otherwise I'll keep this here as I consider it and alter it in the future.

I'll try to do that

Coverage remained the same at 100.0% when pulling 3cf8c4ce3098a97b5ead24a0bbbdc785e060a953 on petekeller2:master into fe83cec4fb6b174ff04f6d0159244fcc6a180b8e on blakeembrey:master.

Coverage remained the same at 100.0% when pulling 3cf8c4ce3098a97b5ead24a0bbbdc785e060a953 on petekeller2:master into fe83cec4fb6b174ff04f6d0159244fcc6a180b8e on blakeembrey:master.

Coverage remained the same at 100.0% when pulling 3e52682f08acd222116f14f83ca4f7368fb1b0b3 on petekeller2:master into fe83cec4fb6b174ff04f6d0159244fcc6a180b8e on blakeembrey:master.

I am looking for this. Any update on this since the may 1st update @blakeembrey ?

@Redsandro You can use the original approach for now until this is released.

If there's more external feedback, I can look into this earlier. I think there's a faster approach here since this PR is still doing a lot of word mutation that wouldn't be necessary to check if it's a plural. I also think it's probably worth not checking irregulars here.

@blakeembrey said:

@Redsandro You can use the original approach for now until this is released.

A premise in the realm of moot. I'm checking for singulars and plurals in a lot of places, and I came to the conclusion that it would make the most sense if this library would handle that.
If nothing else, purely for sugar. :+1:

Nice, thank you. :+1:


Connect to internet radio stream - Radio Nowy Świat

Hello
I tried to connect to this radio station: https://nowyswiat.online/gdzie-nas-slychac/
I tried with http and https connection:

http - stream.rcs.revma.com:80/ypqt40u0x1zuv

01:12:06.847 -> D: Command: station with parameter stream.rcs.revma.com:80/ypqt40u0x1zuv
01:12:06.847 -> D: Connect to new host stream.rcs.revma.com:80/ypqt40u0x1zuv
01:12:06.914 -> D: Connect to stream.rcs.revma.com on port 80, extension /ypqt40u0x1zuv
01:12:07.146 -> D: Connected to server
01:12:07.179 -> D: Switch to HEADER
01:12:07.179 -> D: Location: http://n12a-eu.rcs.revma.com/ypqt40u0x1zuv?rj-ttl=5&rj-tok=AAABdR8fAZ0AzdwDEsVInTelFQ
01:12:07.179 -> D: Content-Length: 0
01:12:07.179 -> D: Connection: close
01:12:07.179 -> D: Set-Cookie: rj-listener-cookie=13fh7i0cwweth; Domain=revma.com
01:12:18.670 -> D: No data input
01:12:27.449 -> D: Command: status (without parameter)
01:12:28.678 -> D: No data input
01:12:28.678 -> D: Trying other station/file...

https - stream.nowyswiat.online:443/mp3

01:14:11.146 -> D: Command: station with parameter stream.nowyswiat.online:443/mp3
01:14:11.610 -> D: Connect to new host stream.nowyswiat.online:443/mp3
01:14:11.676 -> D: Connect to stream.nowyswiat.online on port 443, extension /mp3
01:14:11.875 -> D: Connected to server
01:14:11.908 -> D: Switch to HEADER
01:14:11.908 -> D: Server: cloudflare
01:14:11.908 -> D: Content-Type: text/html
01:14:11.908 -> D: text/html seen.
01:14:11.908 -> D: Content-Length: 253
01:14:11.908 -> D: Connection: close
01:14:11.908 -> D: CF-RAY: -
01:14:11.908 -> D: Switch to DATA, bitrate is 0, metaint is 0
01:14:11.908 -> D: First chunk:
01:14:11.908 -> D: 3C 68 74 6D 6C 3E 0D 0A
01:14:11.908 -> D: 3C 68 65 61 64 3E 3C 74
01:14:11.908 -> D: 69 74 6C 65 3E 34 30 30
01:14:11.941 -> D: 20 54 68 65 20 70 6C 61
01:14:28.666 -> D: No data input
01:14:38.662 -> D: No data input
01:14:38.662 -> D: Trying other station/file...

I must use another url or what?
I use D1 mini with esp8266 and preset radio station mostly work fine.

Try: "stream.rcs.revma.com/ypqt40u0x1zuv" without "http://"
Request to stream.nowyswiat.online/mp3 are redirected to:
Location: https://stream.rcs.revma.com/ypqt40u0x1zuv
HTTPS is not supported by the radio, but since http://stream.rcs.revma.com/ypqt40u0x1zuv also works, you can use
"stream.rcs.revma.com/ypqt40u0x1zuv"

I tried and still can't connect to radio:

11:07:11.747 -> D: Connect to new host stream.rcs.revma.com/ypqt40u0x1zuv
11:07:11.813 -> D: Connect to stream.rcs.revma.com on port 80, extension /ypqt40u0x1zuv
11:07:12.112 -> D: Connected to server
11:07:12.179 -> D: Switch to HEADER
11:07:12.179 -> D: Location: http://n08a-eu.rcs.revma.com/ypqt40u0x1zuv?rj-ttl=5&rj-tok=AAABdSE_0lQAkezm-wizn7WJ1Q
11:07:12.212 -> D: Content-Length: 0
11:07:12.212 -> D: Connection: close
11:07:12.212 -> D: Set-Cookie: rj-listener-cookie=14il1a2q580j9; Domain=revma.com
11:07:13.308 -> D: No data input
11:07:13.308 -> D: Trying other station/file...

Maybe it's problem with ESP3266 version as here: https://github.com/Edzelf/Esp-radio/issues/183. You use ESP32? If this is the issue then I need to buy ESP32.

Maybe the key "ypqt40u0x1zuv" changes for every session.  AT this moment it still works for me.
Try to get the right location (in the logging) by connecting to "stream.nowyswiat.online/mp3"

The same:

11:57:12.105 -> D: Command: station with parameter stream.nowyswiat.online/mp3
11:57:12.138 -> D: Connect to new host stream.nowyswiat.online/mp3
11:57:12.171 -> D: Connect to stream.nowyswiat.online on port 80, extension /mp3
11:57:12.371 -> D: Connected to server
11:57:12.404 -> D: Switch to HEADER
11:57:12.404 -> D: Content-Type: text/html
11:57:12.404 -> D: text/html seen.
11:57:12.404 -> D: Transfer-Encoding: chunked
11:57:12.404 -> D: Connection: close
11:57:12.404 -> D: Set-Cookie: __cfduid=d979775b8a1f7c8101025d521e1e0d2b61602583032; expires=Thu, 12-Nov-20 09:57:12 G
11:57:12.437 -> D: Cache-Control: no-cache, no-store, must-revalidate, max-age=0
11:57:12.437 -> D: Location: https://stream.rcs.revma.com/ypqt40u0x1zuv
11:57:12.437 -> D: X-Turbo-Charged-By: LiteSpeed
11:57:12.437 -> D: CF-Cache-Status: DYNAMIC
11:57:12.437 -> D: cf-request-id: 05c2fd8a2a0000f290f013e200000001
11:57:12.437 -> D: Report-To: {"endpoints":[{"url":"https://a.nel.cloudflare.com/report?lkg-colo=73&lkg-time=160258
11:57:12.437 -> D: Server: cloudflare
11:57:12.470 -> D: CF-RAY: 5e1831f049eaf290-WAW
11:57:12.470 -> D: Switch to DATA, bitrate is 0, metaint is 0
11:57:12.470 -> D: First chunk:
11:57:12.470 -> D: 3C 21 44 4F 43 54 59 50
11:57:12.470 -> D: 45 20 68 74 6D 6C 3E 0A
11:57:12.470 -> D: 3C 68 74 6D 6C 20 73 74
11:57:12.470 -> D: 79 6C 65 3D 22 68 65 69
11:57:13.466 -> D: No data input
11:57:13.466 -> D: Trying other station/file...

I tested it on the ESP32 version of the radio.  I am not sure if chunked transfer is supported on the ESP8266 version.

Okej, so I'm waiting for my esp32 and then I get it I will send update about this issue

I just test this on my ESP8266 radio.  Same result: connaction oka, but chunked stream can not be decoded.

Maybe the key "ypqt40u0x1zuv" changes for every session. AT this moment it still works for me.
Try to get the right location (in the logging) by connecting to "stream.nowyswiat.online/mp3"

Not this key does not change. The end of the address is changed, and the server number is changed (at the beginning of the HTTP address). For example:
http://n14a-eu.rcs.revma.com/ypqt40u0x1zuv?rj-ttl=5&rj-tok=AAABd7E0lvsAjObIsY8Nc-MKtA
I try to use the command on your Radio:
//-----------------------------------------------
const char* headerNames[] = { "Location" };
String Location;

HTTPClient http;
http.begin(URL);
http.collectHeaders(headerNames, sizeof(headerNames)/sizeof(headerNames[0]));
int httpCode = http.GET();

Serial.print (httpCode);
if (httpCode == 302)
{
Serial.println("following redirect");
Location = http.header("Location");
Serial.print ("LOCATION   "); Serial.println (Location);
char url[100];
int  pos = Location.length();
Serial.print("Location.length()  ");    Serial.println (pos);
Location.substring(0, pos).toCharArray(url, pos+1);
Serial.println (url);
}
//---------------------------------------------
They are located after WiFi "connect lines" &
" file = new AudioFileSourceICYStream(url);
file->RegisterMetadataCB(MDCallback, (void*)"ICY");"
The answer is a valid link, but it has already expired. or maybe a future link.
Can You help? This is the only way to listen to this radio


No source?

You mentioned this was open source and the “source” was on GitHub. All I can see are built files in the dist directory here. Can you please add the actual source.

This is a beta version, the source code will be release in the official version.

This is a beta version, the source code will be release in the official version.

That’s not what you said. Make the source available. Otherwise give an actual reason. If you want developers to use your code you need to be more open with it.

The reason is this is a beta version.We will put source code here when we release the official V1.0 version.
This is to enable HA users to experience eWeLink services earlier.
The master branch will be the installation address for ha-addon. After the v1.0 release, the source code will be push to other branches.

This is a beta version, the source code will be release in the official version.

That’s not what you said. Make the source available. Otherwise give an actual reason. If you want developers to use your code you need to be more open with it.

The reason is this is a beta version.We will put source code here when we release the official V1.0 version.
This is to enable HA users to experience eWeLink services earlier.
The master branch will be the installation address for ha-addon. After the v1.0 release, the source code will be push to other branches.

This is a beta version, the source code will be release in the official version.

That’s not what you said. Make the source available. Otherwise give an actual reason. If you want developers to use your code you need to be more open with it.

That makes no sense. This is JavaScript we’re talking about. It’s not like keeping the source private is going to hide anything as the code isn’t even minified. Just release it.

Has been push


Inconsistent BinDiff result using Ghidra BinExports generated on different machines

Hello
I'm trying to use Ghidra for generating BinExports for the diff and diff3 arm binaries. However, the BinDiff log result from these BinExports is not consistent when I generate the same pair of BinExports across different machines.
I'm using the Ghidra 9.2.3 release with the Ghidra extension provided with BinExport 12 release (for BinDiff 7)
I have set up Ghidra on machines with jdk 12.0.2 and  jdk 11.0.15
Difference in BinDiff output with both machines with jdk 12.0.2: diff-result-jdk12.txt
Difference in BinDiff output on machines with jdk 11.0.15 and jdk 12.0.2: diff-result-jdk11-12.txt
Any suggestions on this problem would really help.
Thanks

I can't look into this in a timely fashion, but I suspect this may have something to do with the order in which we export the functions from Ghidra. While the resulting BinExport should always store functions and basic blocks sorted by their address, iteration order during export may not be stable (Ghidra uses unordered maps under the hood, which may change between JDK versions).
Although, when I read the above report again that does not explain the weird difference in diff-result-jdk12.txt...
Can you maybe attach the BinExport pairs to this bug? If that is not possible, can you do a text dump using the binexport2dump tool for each of the 4 BinExports and send me the text-diff of "binaryA_machine1_jdk12.txt" and "binaryA_machine2_jdk12.txt` (and the other pair)?
Also, does this happen on newer versions of Ghidra, too?


Update instance.pp

puppetlabs-concat v2.1.0 reports:
The $ensure parameter to concat::fragment is deprecated and has no effect.

Merged. Thanks!


CosmosDB autoscale

I would like to set my CosmosDB to autoscale throughput, but this does not seem to be an option yet in the CosmosDB SqlDatabase or SqlContainer.

Tracked upstream in https://github.com/terraform-providers/terraform-provider-azurerm/issues/6164

Shipped upstream a while ago


Hint from DATABASE_URL environment variable.

This makes the SQLALCHEMY_DATABASE_URI config default to the DATABASE_URL environment variable, if it exists. If it doesn't exist, it defaults to 'sqlite://', as before.
This allows an app to seamlessly connect to an environment's database in an explicit way, while still complying to Flask's (and werkzeug's) configuration methodologies.

No. There already is "config.from_envvar". This is implicit magic I do not like at all.

Not really related to config.from_envvar...
I'd agree if it was overriding the actual configuration, but it's only changing the fallback setting if a standardized environment variable exists.

Not really related to config.from_envvar...

The idea is to configure based on environment variables. from_envvar does that indirectly. There could even be a from_envvars that would configure the whole config from the environment.

I'd agree if it was overriding the actual configuration, but it's only changing the fallback setting if a standardized environment variable exists.

I do not like this at all :-)

Hmm, a from_envvars would be interesting.

How would from_envvars work?  Enumerating the full environment dictionary and setting each entry as a configuration variable would lead to lots of unnecessary configuration keys (e.g. PAGER, EDITOR, etc.).  It seems like some sort of naming convention would be necessary (similar to from_object's uppercase-only filter).


Max number of character encodable in this implementation

Hi there,
I'd like to know the max number of characters possibly encodable, from what I tested it seemed to be locked at 78 string characters on the L level and depassing that number, it was crashing the widget.
Is there way to encode more than that, because 78 chars seem to be very low in some circumstances.

It seems like you need to raise the version (int).
See: http://www.qrcode.com/en/about/version.html

We wrap the awesome qr.dart library (https://github.com/kevmoo/qr.dart) and that library supports up to version 40. You should see the information that @Cretezy linked to determine which version you need. We don't automatically select the version based on the content size. We may support it in the future but I'm not actively looking into it.


Applied capo recommendations

Matter of taste. I understand if you don't want to mess up with source-code in order to obey Capo recommendations

Applied capo recommendations, as proposed here https://github.com/jpanther/congo/discussions/644
Before:

After:

Hmm I've never heard of this capo project before. I wonder how much this actually impacts performance? I don't think any of these types of changes were flagged by Lighthouse or GTmetrix although I haven't run those tests formally in a little while.

No they are not flagged by Lighthouse. I agree this may be too much. I'm myself wasn't able to see the difference.

I will close it for now. We can reopen it, if needed


Create APIs for address risk

Description
Implementing issue #128.
Three APIs with related tests:

[x] API that, given an address, tells whether it is a soft story
[x] API that, given an address, tells whether it is in a liquefaction zone
[x] API that, given an address, tells whether it is in a zone at risk of tsunami

Translating the address obtained through MapBox autocomplete into a geometrical Point could be handled by the frontend (so we keep all MapBox-related stuff in the frontend), so it is currently out of scope.

Also added pre_commit to requirements-dev.txt.
Type of changes

[ ] Bugfix
[ ] Chore
[x] New Feature

Testing

[x] I added automated tests
[ ] I think tests are unnecessary

How to test

Run app

Soft-story

Go to http://localhost:8000/soft-stories/is-soft-story?lat=-122.446575165&lon=37.766034349 and see that the response is true. This is a coordinate in our soft-story table.
Go to http://localhost:8000/soft-stories/is-soft-story?lat=0&lon=0 and see that the response is false. This is Null Island, which is not in our table.

Liquefaction

Go to http://localhost:8000/liquefaction-zones/is-in-liquefaction-zone?lat=37.779759&lon=-122.407436 and see that the response is true. This is a point at 6th and Howard in a liquefaction zone.
Go to http://localhost:8000/liquefaction-zones/is-in-liquefaction-zone?lat=0&lon=0 and see that the response is false. This is Null Island. Maybe it is in a liquefaction zone, but it's certainly out of our jurisdiction.

Tsunami

Go to http://localhost:8000/tsunami/is-in-tsunami-zone?lat=37.759039&lon=-122.509515 and see that the response is true. This is a point in the Outer Sunset in our table.
Go to http://localhost:8000/tsunami/is-in-tsunami-zone?lat=0&lon=0 and see that the response is false. This is Null Island. Maybe it is at Tsunami risk but it's certainly out of our jurisdiction.

@agennadi docker build failing due to env-file missing in the artifacts?

Closing as the CI pipeline doesn't work from forks.


Complete all OpenSource Repo Checks

Make sure this repo has all the required files and settings for an open source project.

It has been completed by series of different commits. This repo now has all necessary files that an open source library should have.


add --sort-tags

Closes #197

Any tests and documentation of the new flag?

tests
Sorry, not yet. I'll write test soon

documentation
there's documentation on the source code for --help. I'll copy onto README soon.

iPadから送信

2021/06/14 12:23、Jordan Harband @.***>のメール:

Any tests and documentation of the new flag?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

I've added tests and documentation.

Hi, what's the status on this? Can we expect a merge/publish soon or is there something else that needs to be done?

The implementation is done. If the development team think test for this is enough, This pull request is ready to merge. This PR is approved so I think ready to merge.

What is the status on this PR?
We follow semver, but 2.9.0 appears before 2.10.0, so you get the sense that 2.9.0 is a newer tag.

@mrttrifork As I wrote in previous comment, I think it's ready to merge.
@cookpete  How do you feel this PR?

I have every intention of catching up with this and react-player when I can, but life tends to gets busier as you get older. Spare time for open source projects becomes very rare.
Regardless, isn’t this whole PR made redundant by the --append-git-tag option? You can add anything you want to the git tag call without the need for yet another new setting.

Regardless, isn’t this whole PR made redundant by the --append-git-tag option? You can add anything you want to the git tag call without the need for yet another new setting.

I think no because the auto-changelog sorts tags by semver after git tag command.

Good point @anatawa12. In that case I would rather just look for "--sort" inside options.appendGitTag and not sort the tags if it exists.
I’m still trying to understand the use case here? How else would you want to sort your tags?


How do I implement data migration of CMAK?

My CMAK is kafka-manager-<IP_ADDRESS> ,Now I hope to upgrade it ?
I have a question, when i start two version CMAK processes ,
how to implement data migration from old version to new version  and two CMAK do not affect each other?

It is backwards compatible, you should be able to just use latest version and it will look at same location in zookeeper.

You can have both old and new version running, but old version would fail as soon as you modified any cluster config with a newer version of kafka then the old version supports.

You should be able to copy the old application.conf over to the new version and it should work out of the box.  Just the new version runs with command bin/cmak instead of bin/kafka-manager.


BUG: Column headers on Test Results table are mislabeled

On the training site:

"Symptomatic" column is mislabeled as "Submitter"
"Submitter" column is mislabeled as "Actions"
"Actions" column is missing a label

This is also the case on demo.simplereport.gov and I'm assuming simplereport.gov (but I can't confirm because I can't get into my account for some reason).

@katiealoisi it looks like this is fixed. I'm going to close this out but if you see it again please re-open it.


Register command for creating clients in OAuth2ServerServiceProvider

Userland doesn't seem like the best way to accomplish this—the command should be available for Laravel 5 out of the box when the service provider is registered.

The command has been removed, there's no use for adding it back. I'll eventually develop a separate package to offer this kind of functionality.


pkg/trace/api: use different fd acquisition method for UDS

What does this PR do?
We switch the UDS credential code to use SyscallConn() to get the underlying fd without duplicating the fd.
We also implement a benchmark, which shows an 11% improvement in performance reading over the socket with the new method.

Motivation
For UDS connections, we need to get the file descriptor to call the linux-specific GetsockoptUcred syscall. We had been using conn.File(), but this duplicates the file descriptor and causes performance issues (see https://github.com/golang/go/issues/22953).
Additional Notes

Possible Drawbacks / Trade-offs

Describe how to test/QA your changes
Tests show that the new method works, but during QA we should run a trace agent and connect a tracer to it over UDS, ensuring that container tags still work.

/merge


Configurability enhancements - Report section

Add validations to the Report section data to support more robust configurability.
The following tickets are part of this main ticket:

[x] #592
[x] #593

This issue will be addressed in cQube v5.0.

This is related to cQube v4.1 beta


fix: username with camel case produces multiple user session with dif…

@TNorad Thanks for your PR. And, can you explain how it is happened or how to reproduce it?

@TNorad I find the reason. Because the Keycloak will always convert the username to lower-case, so we need to do this also. Thanks again! :)

Thx to you :)


Adding a isPartialWithdrawal boolean flag to Withdrawals

Has adding a isPartialWithdrawal boolean flag to Withdrawals to differentiate partial from full withdrawals ever been suggested?
Something like
class Withdrawal(Container):
    index: WithdrawalIndex
    validator_index: ValidatorIndex
    address: ExecutionAddress
    amount: Gwei
    is_partial_withdrawal: Boolean

This would largely simplify our life at EigenLayer when trying to let operator beacon chain eth be restaked into middlewares, and we want to let validators instantly instantly withdraw their partial withdrawals from the EL contract, whereas full_withdrawals need to wait a certain period of time for unstaking in middlewares to happen before the validator is allowed to withdraw from the EL contract.
We can prove that a partial withdrawal is partial by also giving a merkle proof that the validator was still active, but this is a huge proof which requires downloading the full beacon state (many MBs), which is too costly to prove a simple partial withdrawal.
I apologize if such a discussion has already happened elsewhere... please point me to that place (perhaps ethresear.ch?) is so!

can prove that a partial withdrawal is partial by also giving a merkle proof that the validator was still active,
recall there are a spectrum of validator lifecycle states between "active" and when a "full" withdrawal would take place (e.g. in particular if you had a withdrawal for a validator, you'd want to check validator.withdrawable_epoch <= epoch

another note: it is quite late in the process of shipping this feature to mainnet and I don't expect anything will change unless there is an explicit security issue discovered
regarding detecting partial vs full withdrawals, you'd be right 99% if not 100% of the time by simply executing
def is_partial_withdrawal(amount: Gwei) -> bool:
    return amount < 1_ETH

whereas full_withdrawals need to wait a certain period of time for unstaking in middlewares to happen before the validator is allowed to withdraw from the EL contract.

can you elaborate why you have the different latency constraints here?

Your is_partial_withdrawal is pretty much what we're doing at this point, but the very first partial withdrawal will be a major exception, with validators currently having on average an extra 2 ETH which will be partially withdrawn at the shapella fork. There's also a weird case where a full withdrawal can disguise as a partial withdrawal: if a validator gets slashed and is about to get ejected, he might as well try to get slashed down to < 1_ETH (I know this is not that easy to do though), in which case he'll be able to withdraw his ETH as a partial withdrawal (can't say more right now as to why that is a problem in our architecture, but it is). And the reverse could also cause some UX frictions for us: having a partial withdrawal be disguised as a full withdrawal (mostly through user making a mistake in his interaction with the smart contract).

can you elaborate why you have the different latency constraints here?

Basically for the very same reason that beacon chain validators need to wait ~27 hours before they can withdraw after exiting: need to give time in case the validator did something wrong and should get slashed.

and another question: if you aim to go the proof route in a smart contract and want to do this trustlessly then you'll need a way to get the beacon accumulator inside the EVM -- there is work on EIP-4788 but it isn't the highest priority amongst other work e.g. on EIP-4844 in my estimation -- have you considered how you'd tackle this?

We don't have any way other than to bring the beacon state root to the EL trustedly via a multi-sig oracle, very similar to what Lido and Rocketpool are doing. Difference is that they bring aggregated information (sum of the balance of all their validators) whereas we only need the beacon state root, so we'll be ready to swap whenever EIP-4788 is released.

You could delay partial withdrawals the same time as full withdrawals; not the best UX but not terrible if people are signing up to your system and know the risks.
Alternatively you could provide a proof generator for the validator state.  If this had an external API then your users could either run their own proof generator if they wanted the extra confidence that they could generate the proofs, or use one of a few public ones if the wanted the convenience of not requiring downloads of the beacon state.  Although it seems that if someone wants to be leveraging their stake then having access to their own beacon node wouldn't be an unreasonable ask.

One particularly fun part of partial withdrawals, they can be arbitrarily large... Some validators have done double deposits so they may get in excess of 32 ETH back on the first 'partial' withdrawal...
If you were able to also get the validator status for each validator, then you'd be able to determine if it's exited vs. withdrawn, and you'd be able to tell if they're off boarding, which seems like the context you're looking for.
Once funds are actually released by the beacon-chain, I'm not sure downstream needs to wait further time. If they get to a point where they've had funds moved, they've passed the validations and should be free to access their funds, so I'm not sure if further checks need to be done further down, there's no 'claw-back' kind of mechanism...


RFP - qrcp

Checklist

[x] The package I am requesting does not already exist on https://chocolatey.org/packages;
[x] There is no open issue for this package;
[x] The issue title starts with 'RFP - ';
[x] The download URL is public and not locked behind a paywall / login;

Package Details
Software project URL :https://claudiodangelis.com/qrcp/
Direct download URL for the software / installer : https://github.com/claudiodangelis/qrcp/releases/download/0.8.4/qrcp_0.8.4_Windows_x86_64.tar.gz
Software summary / short description:
Transfer files over Wi-Fi from your computer to a mobile device by scanning a QR code without leaving the terminal

I pick up this package :slightly_smiling_face:
I actually already have created a Chocolatey package which is currently waiting for the review of Moderators :wink:

This package has been reviewed and approved by @gep13 :slightly_smiling_face:

Thanks for creating the package @Xav83


Checkpoint 1 Review

Description

Fixed the contents of Login.jsx in the center

Coverage remained the same at 100.0% when pulling 76dc352c15696dd4240eee36c443a06b3be56c95 on checkpoint/feedback/align-login-elements-to-center into a9022306bfbacbc3febc0cc0cbd771b2f649e271 on develop.


Fix typo in README

Found a small typo in the README

Although it's not a word, we do use the phrase "automagic" for magical experiences on Railway. Appreciate the PR but this will be marked as a "Won't Fix, Not a Bug." :)


TARIC validations

We also have conflicts now @mauricioac need to rebase

@macool even

This branch is not being used anymore.


feature: space framework supports kube-binding between producers and consumers of space functionality

Feature Description
kube-bind provides better isolation between consumers than the baseline Kubernetes API machinery.  It would be good if the space framework supported this better isolation between consumers of the space framework's functionality.
In other words, this is about the space manager being a kube-bind service provider.
Proposed Solution
Do it.
Want to contribute?

[ ] I would like to work on this issue.

Additional Context
No response

@effi-ofer is this something we 'must' address before sept 15th?

@clubanderson I don't think so.  Adding @ezrasilvera to the discussion.

we could live with this not being implemented on Sept 15th, but it will create more debt that we want to clear up within short order thereafter.

Moot.


Features Zero Warnings

What does the pull request do?

Removal of build warnings
What is the current behavior?

What is the updated/expected behavior with this PR?

How was the solution implemented (if it's not obvious)?

Checklist
Language Reference

[x] CS0067: The event 'event' is never used.
[x] CS0108: member1' hides inherited member 'member2'. Use the new keyword if hiding was intended.
[x] CS0168: The variable 'var' is declared but never used.
[x] CS0169: The private field 'class member' is never used.
[x] CS0414: The private field 'field' is assigned but its value is never used.
[x] CS0618: A class member was marked with the Obsolete attribute, such that a warning will be issued when the class member is referenced.
[x] CS0642: Possible mistaken empty statement.
[x] CS0649: Field 'field' is never assigned to, and will always have its default value 'value'.
[x] CS0659: 'class' overrides Object.Equals(object o) but does not override Object.GetHashCode().
[x] CS0675: Bitwise-or operator used on a sign-extended operand; consider casting to a smaller unsigned type first.
[x] CS8509: The switch expression does not handle all possible inputs when it does.

XML Docs

[x] CS1570: XML comment on 'construct' has badly formed XML - 'reason'.
[x] CS1572: XML comment on 'construct' has a param tag for 'parameter', but there is no parameter by that name.
[x] CS1573: Parameter 'parameter' has no matching param tag in the XML comment for 'parameter' (but other parameters do).
[x] CS1574: XML comment on 'construct' has syntactically incorrect cref attribute 'name'.
[x] CS1587: XML comment is not placed on a valid language element.

Async

[x] CS1998: This async method lacks 'await'.
[x] CS4014: Because this call is not awaited, execution of the current method continues before the call is completed. Consider applying the 'await' operator to the result of the call.

Nullable

[x] CS8602: Dereference of a possibly null reference.
[x] CS8604: Possible null reference argument for parameter.
[x] CS8618: Non-nullable field 'testField' is uninitialized.
[x] CS8625: Cannot convert null literal to non-nullable reference or unconstrained type parameter.
[x] CS8632: The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.
[x] CS8653: A default expression introduces a null value when 'T' is a non-nullable reference type.

Builds

[x] MSBXXXX: 'ExtrasEnableWpfProjectSetup' is deprecated

Packaging

[x] NU5040: The 'PackageIconUrl'/'iconUrl' element is deprecated.
[x] NU5128:  Some target frameworks declared in the dependencies group of the nuspec and the lib/ref folder do not have exact matches in the other location.

Breaking changes

Fixed issues

wow, this is quite extensive :) hope we can get rid of all warnings (however impossible it may seem lol)

🎉 this really needs doing!

Thanks for doing this!

Maybe where nullable is enabled add the following?
<WarningsAsErrors>nullable</WarningsAsErrors>

https://stackoverflow.com/a/62116924

I would also recommend https://github.com/dotnet/roslyn-analyzers
But it could take even more time to fix every warning from it.

@rstm-sf unfortunately Roslyn is unable to do nullable analysis properly and constantly gives false positives.

Do we enable warnings as errors on the CI after merging this PR? To prevent further warning debt from building up?

Hi,
these are latest warnings i have in my local build.
Gestures.cs(77,21): warning CS0618: 'PointerPressedEventArgs.ClickCount' is obsolete: 'Use DoubleTapped event or Gestures.DoubleRightTapped attached event' [C:\GitHub\Avalonia\src\Avalonia.Input\Avalonia.Input.csproj]
Gestures.cs(81,49): warning CS0618: 'PointerPressedEventArgs.ClickCount' is obsolete: 'Use DoubleTapped event or Gestures.DoubleRightTapped attached event' [C:\GitHub\Avalonia\src\Avalonia.Input\Avalonia.Input.csproj]
Primitives\PopupPositioning\IPopupPositioner.cs(451,50): warning CS0618: 'IMouseDevice.Position' is obsolete: 'Use PointerEventArgs.GetPosition' [C:\GitHub\Avalonia\src\Avalonia.Controls\Avalonia.Controls.csproj]
TextBox.cs(756,25): warning CS0618: 'PointerPressedEventArgs.ClickCount' is obsolete: 'Use DoubleTapped event or Gestures.DoubleRightTapped attached event' [C:\GitHub\Avalonia\src\Avalonia.Controls\Avalonia.Controls.csproj]
Platform\InternalPlatformThreadingInterface.cs(86,39): warning CS0067: The event 'InternalPlatformThreadingInterface.Tick' is never used [C:\GitHub\Avalonia\src\Avalonia.Controls\Avalonia.Controls.csproj]
DBusMenuExporter.cs(383,60): warning CS0067: The event 'DBusMenuExporter.DBusMenuExporterImpl.ItemActivationRequested' is never used [C:\GitHub\Avalonia\src\Avalonia.FreeDesktop\Avalonia.FreeDesktop.csproj]
DBusMenuExporter.cs(384,51): warning CS0067: The event 'DBusMenuExporter.DBusMenuExporterImpl.PropertiesChanged' is never used [C:\GitHub\Avalonia\src\Avalonia.FreeDesktop\Avalonia.FreeDesktop.csproj]
DBusMenuExporter.cs(381,17): warning CS0067: The event 'DBusMenuExporter.DBusMenuExporterImpl.ItemsPropertiesUpdated' is never used [C:\GitHub\Avalonia\src\Avalonia.FreeDesktop\Avalonia.FreeDesktop.csproj]
EglInterface.cs(70,34): warning CS0108: 'EglInterface.GetProcAddress' hides inherited member 'GlInterfaceBase<object>.GetProcAddress(string)'. Use the new keyword if hiding was intended. [C:\GitHub\Avalonia\src\Avalonia.OpenGL\Avalonia.OpenGL.csproj]
GlInterface.cs(88,28): warning CS0108: 'GlInterface.GetStringNative' hides inherited member 'GlBasicInfoInterface<GlInterface.GlContextInfo>.GetStringNative'. Use the new keyword if hiding was intended. [C:\GitHub\Avalonia\src\Avalonia.OpenGL\Avalonia.OpenGL.csproj]
GlInterface.cs(90,23): warning CS0108: 'GlInterface.GetString(int)' hides inherited member 'GlBasicInfoInterface<GlInterface.GlContextInfo>.GetString(int)'. Use the new keyword if hiding was intended. [C:\GitHub\Avalonia\src\Avalonia.OpenGL\Avalonia.OpenGL.csproj]
GlInterface.cs(100,30): warning CS0108: 'GlInterface.GetIntegerv' hides inherited member 'GlBasicInfoInterface<GlInterface.GlContextInfo>.GetIntegerv'. Use the new keyword if hiding was intended. [C:\GitHub\Avalonia\src\Avalonia.OpenGL\Avalonia.OpenGL.csproj]
ManagedFileChooser.xaml.cs(38,17): warning CS0618: 'PointerPressedEventArgs.ClickCount' is obsolete: 'Use DoubleTapped event or Gestures.DoubleRightTapped attached event' [C:\GitHub\Avalonia\src\Avalonia.Dialogs\Avalonia.Dialogs.csproj]
Remote\FileWatcherTransport.cs(62,76): warning CS0067: The event 'FileWatcherTransport.OnException' is never used [C:\GitHub\Avalonia\src\Avalonia.DesignerSupport\Avalonia.DesignerSupport.csproj]
Parsers\ExpressionObserverBuilderTests_Negation.cs(177,67): warning CS0067: The event 'ExpressionObserverBuilderTests_Negation.Test.ErrorsChanged' is never used [C:\GitHub\Avalonia\tests\Avalonia.Markup.UnitTests\Avalonia.Markup.UnitTests.csproj]
NullThreadingPlatform.cs(26,50): warning CS0067: The event 'NullThreadingPlatform.Signaled' is never used [C:\GitHub\Avalonia\tests\Avalonia.Benchmarks\Avalonia.Benchmarks.csproj]
NullRenderer.cs(12,62): warning CS0067: The event 'NullRenderer.SceneInvalidated' is never used [C:\GitHub\Avalonia\tests\Avalonia.Benchmarks\Avalonia.Benchmarks.csproj]
Diagnostics\Views\MainWindow.xaml.cs(78,63): warning CS0618: 'IPointerDevice.GetPosition(IVisual)' is obsolete: 'Use PointerEventArgs.GetPosition' [C:\GitHub\Avalonia\src\Avalonia.Diagnostics\Avalonia.Diagnostics.csproj]
Parsers\ExpressionObserverBuilderTests_Negation.cs(177,67): warning CS0067: The event 'ExpressionObserverBuilderTests_Negation.Test.ErrorsChanged' is never used [C:\GitHub\Avalonia\tests\Avalonia.Markup.UnitTests\Avalonia.Markup.UnitTests.csproj]
ControlTests.cs(555,66): warning CS0067: The event 'ControlTests.NullRenderer.SceneInvalidated' is never used [C:\GitHub\Avalonia\tests\Avalonia.LeakTests\Avalonia.LeakTests.csproj]
AvaloniaNativeMenuExporter.cs(37,35): warning CS0067: The event 'AvaloniaNativeMenuExporter.OnIsNativeMenuExportedChanged' is never used [C:\GitHub\Avalonia\src\Avalonia.Native\Avalonia.Native.csproj]

To solve them I need your help.

CS0067: Can I remove unused events?
warning CS0618: 'PointerPressedEventArgs.ClickCount' is obsolete. : I think it is better to remove the obsolete attribute because this property can be useful when you need to manage custom gestures..
** warning CS0108: 'GlInterface.GetStringNative' hides inherited member **: I think it is better to change the signature of the methods because it could cause unexpected results. Here is an example of what could happen.

Why CI ignore nullable attribute? We can see this.

on c.i., I was unable to resolve the following warnings.
Data/BindingValue.cs(249,42): warning CS8601: Possible null reference assignment. [/home/vsts/work/1/s/src/Avalonia.Base/Avalonia.Base.csproj]
Styling/Setter.cs(106,21): warning CS8601: Possible null reference assignment. [/home/vsts/work/1/s/src/Avalonia.Styling/Avalonia.Styling.csproj]
Styling/Setter.cs(128,21): warning CS8601: Possible null reference assignment. [/home/vsts/work/1/s/src/Avalonia.Styling/Avalonia.Styling.csproj]
Users/runner/hostedtoolcache/dotnet/sdk/3.1.101/Sdks/NuGet.Build.Tasks.Pack/buildCrossTargeting/NuGet.Build.Tasks.Pack.targets(198,5): warning NU5128: Some target frameworks declared in the dependencies group of the nuspec and the lib/ref folder do not have exact matches in the other location. Consult the list of actions below: [/Users/runner/work/1/s/src/Avalonia.Build.Tasks/Avalonia.Build.Tasks.csproj]

Can someone give me some tips?

Ramain only this warnings on linux and mac:
Data/BindingValue.cs(249,42): warning CS8601: Possible null reference assignment. [/home/vsts/work/1/s/src/Avalonia.Base/Avalonia.Base.csproj]
Styling/Setter.cs(106,21): warning CS8601: Possible null reference assignment. [/home/vsts/work/1/s/src/Avalonia.Styling/Avalonia.Styling.csproj]
Styling/Setter.cs(128,21): warning CS8601: Possible null reference assignment. [/home/vsts/work/1/s/src/Avalonia.Styling/Avalonia.Styling.csproj]

@kekekeks @danwalmsley can we review?

Zero Warnings!!!
Finally there isn't' warnings.

Thou shalt not break the public API
Thou shalt not listen to compiler when it complains about CS0067 for it ignores interface implementation requirements
Thou shalt never use Task.Result and GetAwaiter().GetResult() for they will deadlock the app
Thou shalt not replace async void  with async Task just because compiler asks you to.

thanks for the tips

I have doubts about these lines of code:
https://github.com/AvaloniaUI/Avalonia/blob/023b25f0417317c069a3ccb60dcc4d5a90a11353/src/Avalonia.Controls/TextBox.cs#L543-L546
DeleteSelection() might be done before the copy is finished.

DeleteSelection() might be done before the copy is finished.

Yes, but the actual copy operation might take a while, so we might confuse the user by not handling the hotkey as expected and not removing the selection.

At present 2e4c911 there are 2 NU5128 warnings in macOs, this depends on miss net461 build target for ControlCatalog.Desktop. Can I remove ControlCatalog.Desktop from non-Windows builds?
 ControlCatalog.Desktop -> /Users/runner/work/1/s/samples/ControlCatalog.Desktop/bin/Release/net461/ControlCatalog.Desktop.exe
##[warning]/Users/runner/hostedtoolcache/dotnet/sdk/3.1.401/Sdks/NuGet.Build.Tasks.Pack/buildCrossTargeting/NuGet.Build.Tasks.Pack.targets(198,5): warning NU5128: Some target frameworks declared in the dependencies group of the nuspec and the lib/ref folder do not have exact matches in the other location. Consult the list of actions below: [/Users/runner/work/1/s/src/Avalonia.Build.Tasks/Avalonia.Build.Tasks.csproj]
##[warning]/Users/runner/hostedtoolcache/dotnet/sdk/3.1.401/Sdks/NuGet.Build.Tasks.Pack/buildCrossTargeting/NuGet.Build.Tasks.Pack.targets(198,5): warning NU5128: - Add lib or ref assemblies for the netstandard2.0 target framework [/Users/runner/work/1/s/src/Avalonia.Build.Tasks/Avalonia.Build.Tasks.csproj]

@workgroupengineering can you do without force-pushing on such a big changes?

after merging the master (e2ea0d5), these warnings are reported:
Win32GlManager.cs(10,29): warning CS0169: The field 'Win32GlManager.s_attemptedToInitialize' is never used [/home/vsts/work/1/s/src/Windows/Avalonia.Win32/Avalonia.Win32.csproj]
Gpu/OpenGl/GlSkiaGpu.cs(69,30): warning CS0168: The variable 'e' is declared but never used [/home/vsts/work/1/s/src/Skia/Avalonia.Skia/Avalonia.Skia.csproj]

Can i remove this @kekekeks ?
https://github.com/AvaloniaUI/Avalonia/blob/129dfdadd9244db4da40b9c9813642b7aaa13d22/src/Windows/Avalonia.Win32/Win32GlManager.cs#L10
Can I remove the variable 'e' or add it to the error message?
https://github.com/AvaloniaUI/Avalonia/blob/129dfdadd9244db4da40b9c9813642b7aaa13d22/src/Skia/Avalonia.Skia/Gpu/OpenGl/GlSkiaGpu.cs#L69-L75

Hi @workgroupengineering we've been talking about this PR and it's just too big and contains too much of a mix of changes for us to feel confident merging as-is (it took me about an hour to do a proper review and there have been a number of changes since).
We think that it needs splitting up into at least two separate PRs:

Changes which obviously don't affect functionality, or just affect samples etc
Changes which alter code and could affect functionality in the base library

I know we've been stringing you along for a long time with this PR and I apologize and understand if you don't want to do this. If you would prefer, one of us could do it and credit you as a co-author in the commits.

Hi,

We think that it needs splitting up into at least two separate PRs:
* Changes which obviously don't affect functionality, or just affect samples etc

* Changes which alter code and could affect functionality in the base library

hi, at the moment I don't have time to make the required changes.

I know we've been stringing you along for a long time with this PR and I apologize and understand if you don't want to do this. If you would prefer, one of us could do it and credit you as a co-author in the commits.

I have no problem, do as you see fit.


Support Matrix additional to Discord

Feature Description
Would be great if you would support Matrix (element.io), too.
I bridge some of your rooms to Matrix, but a official Matrix would be great.
Perhaps bridged with your discord Server?
https://t2bot.io/discord/

Maybe if Discord dies.


Define "interior mutability"

per @RalfJung..

at least in my mind, interior mutability is pretty much settled

Hm, I know it was me who said that but the "non-transitively" part is probably confusing. Might be better to remove this and instead mention that this stops at raw pointers.
Or maybe this is better explained by pointing out the pattern this violates? "Memory behind a shared reference is not mutated (transitively through references and boxes, but not through raw pointers)". If you do it anyway, (a) you need to wrap the memory being mutated (NOT the reference!) into UnsafeCell and (b) then you have interior mutability. Does that make sense?

(Maybe this is the wrong place to raise this but I've always wished we called this "shared mutability" rather than inventing our own terminology with "interior". "Shared mutability" is a concept already widely known outside of Rust, and AFAIA, its definition matches what we wish to denote by it within Rust. Also the shared mutability <-> shared references suggestiveness is nice.)

@avadacatavra I am confused. I do not understand the distinction you are making between Cell in general and Cell to mutate a field on a struct.

@RalfJung ...now that I'm rereading this I'm not sure what was going on in my head...
I think that the definition in this PR confused me (and I was commenting at 1am which couldn't have helped)

Since the wider Rust community uses interior mutability, I consider it out of scope for this WG to change it to "shared mutability." I'm going to merge this and if we decide to refine the definition at a later date, then we can

Should we open an issue to track that? Whether it is in scope for this WG to change that, and whether it should be changed?


How to finetune certain params  via from HF's transformers, a

I have to add one some LoRA layers by hand(without left) to a pre-trained Multi-modal model( only on vision part), to finetune the model for new data. I want Deepspeed to optimize ONLY the parameters from the newly added
LoRA layer rather than all the parameters. Like this

The platform is hugging face's transformers and Deepspeed.
Therefore I decorate the Trainer from HF's transformers, as below:

Unfortunately, it doesn't work, both LoRA and non-LoRa's weights are not changed during training. It seems that the optimizer in Deepspeed is not the same as that from Pytorch.
My question is, are there any ways that allow me to ONLY finetune certain subnet (LoRA) parameters with Deepspeed+Transformer's Trainer?

Hello, in our training of the monkey and monkey-chat models, we only added LoRA to the ViT part, and the LLM was fully trained. You can add similar code to line 368 of  finetune_multitask.py to set requires_grad_ to False for parameters you don't need to train, and True for those you do. Please make sure to identify the names of the parameters you don't need to train.
for k,v in model.named_parameters():
    if "lora" in k :#replace "lora" with the names of the parameters you need to train
        v.requires_grad_(True)


Calling external functions/FFI

What would be the MWE for calling external (C) functions from Lily code? I can't seem to find a sample or a documentation entry for this. TIA.

Thank you, I think I got the idea.


Binder rendering not working

The option to open the notebook in binder isn't present on the template juypter books website, and using the link directly in the repo redirects to an error page (screenshots attached).

Hi @dgmccart - the current rendered documentation url should be
https://napari.github.io/napari-workshop-template
(see #7 ). In there, if you go to any notebook you can see the binder link. I am also updating the link in the readme to point to the right place - thanks for opening the issue!

I'm going to close this, binder is super slow but has been working for me.


Feature/setup pipeline

Reference issue #11
Tasks

[x] Strage Build - 2024-11-27
[ ] Strage Release

What was done?

Added the engine requirement for Node.js >=22.0.0 in package.json. This is necessary because the project dependencies require this version.
Added a new command in package.json: npm run test:ci.
Added a new command in package.json: npm run lint:fix.
Implemented the "StageBuild" workflow in GitHub Actions.

What pipeline trigger ?

Pipeline trigger when is done push and branch is feature/*

Important
The tests have specific settings for coverage, but now they were temporarily adjusted to fix the pipeline. Basically, the minimum coverage was 80% and now is 77% to pass the pipeline, and statements were -10 and now are -11.

Can be solved here:  #19
Commit reference: 7fcb45363b9c95d38a0963e39d4dad1b4f21b08b

Overview Stage Build:

We need to talk about how the pipeline will be triggered and also the launch. I made a more simplified version of stragebuild


Resolves #2242

Fix example typo
https://github.com/MicrosoftDocs/windows-powershell-docs/issues/2242

Docs Build status updates of commit 739e72c:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/windows/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (win10-ps)

docset/winserver2012-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012-ps)

docset/winserver2012r2-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012r2-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 739e72c:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/windows/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (win10-ps)

docset/winserver2012-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012-ps)

docset/winserver2012r2-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012r2-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit ab0b38c:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/windows/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (win10-ps)

docset/winserver2012-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012-ps)

docset/winserver2012r2-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012r2-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit ab0b38c:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/windows/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (win10-ps)

docset/winserver2012-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012-ps)

docset/winserver2012r2-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012r2-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

cc @JohanFreelancer9

cc @JohanFreelancer9

Docs Build status updates of commit a4250b2:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/windows/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (win10-ps)

docset/winserver2012-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012-ps)

docset/winserver2012r2-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012r2-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit a4250b2:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/windows/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (win10-ps)

docset/winserver2012-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012-ps)

docset/winserver2012r2-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012r2-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit f4d77f1:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/windows/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (win10-ps)

docset/winserver2012-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012-ps)

docset/winserver2012r2-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012r2-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit f4d77f1:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docset/windows/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (win10-ps)

docset/winserver2012-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012-ps)

docset/winserver2012r2-ps/troubleshootingpack/Invoke-TroubleshootingPack.md
:white_check_mark:Succeeded
View (winserver2012r2-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


Notion Webclipper functionality

The webclipper is convenient because it also saves the content of the page.
I'd love to be able to programmatically request Notion to parse and save the contents of links into a Notion table.
Background: I want any link I store into my Pocket account to also be available in my Notion list (especially the content).

This would be a great candidate for a community contribution, if anyone wants to take a stab! I haven't played with the webclipper functionality much yet myself, or looked at the backend data structures. Happy to answer questions, though, if anyone wants to take it on.

I'll try my hand at it later today.
Looks like the endpoints are getWebClipperData, searchWebClipperPages, and addWebClipperURLs

In simplest way looks like requests.post can be used
curl -X POST -H "Content-Type: application/json" --cookie "token_v2="YOURTOKEN" -d '{"type":"block","blockId":"BLOCK_WHERE_PAGE_APPEAR","items":[{"url":"https://gist.github.com/subfuzion/08c5d85437d5d4f00e58","title":"curl examples"}],"from":"curl"}' https://www.notion.so/api/v3/addWebClipperURLs
Will get you response:
{"parentBlock":{"record":{"table":"block","type":"page","id":"PAGEID","role":"editor","name":"NAME","iconEmoji":"📲"},"ancestors":[]},"createdBlockIds":["CREATEDBLOCKID"]}
Data pass formatted:
{
    "type": "block",
    "blockId": "BLOCK_WHERE_PAGE_APPEAR",
    "items": [
        {
            "url": "URL",
            "title": "TITLE"
        }
    ],
    "from": "ANYTHING?"
}

Url https://www.notion.so/api/v3/addWebClipperURLs
Whole page structure renders in Notion correctly. I guess backend is responsible to that.

Thank you for providing the raw curl command. Unfortunately it doesn't seem to work, I'm getting the following response:
{
   "errorId":"RANDOM ID",
   "name":"ValidationError",
   "message":"Invalid record request"
}

in "blockId" I passed top-level page.id gotten from:
page = client.get_block("https://www.notion.so/PAGE")
page.id
'99999999-9999-9999-9999-999999999999'

{
    "type": "block",
    "blockId": "99999999-9999-9999-9999-999999999999",
    "items": [
        {
            "url": "https://www.postgresql.org/docs/current/functions-json.html",
            "title": "result page"
        }
    ],
    "from": "ANYTHING?"
}

https://www.notion.so/result-page-85559943128b4c14803f7d1de15017a3

Oh my bad, somehow I thought the blockId is just the url part (in your example PAGE). Thank you for clarifying!

Did anybody make any progress on adding this to the library? Let me know if you have any questions!

in "blockId" I passed top-level page.id gotten from:
page = client.get_block("https://www.notion.so/PAGE")
page.id
'99999999-9999-9999-9999-999999999999'

{
    "type": "block",
    "blockId": "99999999-9999-9999-9999-999999999999",
    "items": [
        {
            "url": "https://www.postgresql.org/docs/current/functions-json.html",
            "title": "result page"
        }
    ],
    "from": "ANYTHING?"
}

https://www.notion.so/result-page-85559943128b4c14803f7d1de15017a3

hello, I have tried what you say, but still get response like:
{
"errorId":"RANDOM ID",
"name":"ValidationError",
"message":"Invalid record request"
}
May I ask if your code still work?
And can you tell me if https://www.notion.so/PAGE in " page = client.get_block("https://www.notion.so/PAGE") " must be a database page or normal page? I was confused
Thanks!

Take a look on how I have implemented it myself https://github.com/elblogbruno/NotionAI-MyMind

I've been trying to make this curl command work but got responses like :
"name":"ValidationError","message":"Invalid input.
"name":"ValidationError","message":"User cannot edit block."

Turned out

"from":"curl" is currently invalid - "from":"chrome" works
block id should be formatted with dashes - using pageid copied directly from URL won't work (my bad)

Thanks @elblogbruno for code sample.

curl -X POST -H "Content-Type: application/json" --cookie "token_v2="YOURTOKEN" -d '{"type":"block","blockId":"PAGE_WHERE_WEBCLIPPEDPAGE_APPEAR","items":[{"url":"https://gist.github.com/subfuzion/08c5d85437d5d4f00e58","title":"curl examples"}],"from":"curl"}' https://www.notion.so/api/v3/addWebClipperURLs

Hey,
Just for learning purposes ,
I tried my hand in obtaining the addWebClipperURLs , i was using Google Chrome , when i trigger the Webclipper Extension , i couldn't register any network calls , What method did you try ?

Hey,
Just for learning purposes ,
I tried my hand in obtaining the addWebClipperURLs , i was using Google Chrome , when i trigger the Webclipper Extension , i couldn't register any network calls , What method did you try ?

You can debug extension and there you can view network calls.
BTW with official API I'm not sure how this will work in future

Hey,
Just for learning purposes ,
I tried my hand in obtaining the addWebClipperURLs , i was using Google Chrome , when i trigger the Webclipper Extension , i couldn't register any network calls , What method did you try ?

You can debug extension and there you can view network calls.
BTW with official API I'm not sure how this will work in future

Hey
Thanks btw,
But for me
Inspect views : background.html is not coming , when i open manage extensions

May be they might have done something to hide it ... not sure though

Hey
Thanks btw,
But for me
Inspect views : background.html is not coming , when i open manage extensions

May be they might have done something to hide it ... not sure though

No problem.
I left Chrome a while, found on SO this answer which might help. May be it's under details?

@TitusRobyK can you try this method? chrome-extension://<extension-id>/background.html Found from this article

Hey,
Just for learning purposes ,
I tried my hand in obtaining the addWebClipperURLs , i was using Google Chrome , when i trigger the Webclipper Extension , i couldn't register any network calls , What method did you try ?

You can debug extension and there you can view network calls.
BTW with official API I'm not sure how this will work in future

Thank a lot @Blucknote

chrome-extension:///background.html

Nope this did not work , Even checked the Network call as well , upon adding an article via Notion Web Clipper , I guess its some sort of new implementation i think ( i am not sure though )

Hi, it seems that the Notion web clipper does not use background html, but it uses popup html(and the file name is index.html). So you can check network calls via inspection of popup html.

Hi, it seems that the Notion web clipper does not use background html, but it uses popup html(and the file name is index.html). So you can check network calls via inspection of popup html.

thank you !!!!!
Never noticed it


feat(nibijs): functions for humans + getTxByHash (exchange integration)

feat(nibijs): functions for humans + getTxByHash
chore(nibijs): build docs
Closes https://github.com/NibiruChain/ts-sdk/issues/258

Summary by CodeRabbit

Documentation

Updated documentation URLs for class and method definitions across various markdown files.
Added documentation for new methods getTxByHash and getTxByHashBytes in NibiruQueryClient.md.

New Features

Introduced new methods in NibiruQueryClient for fetching transaction details by hash.

Refactor

Replaced go function with Result class in chain.ts to handle asynchronous operations more effectively.
Added bytesToHex and hexToBytes utility functions in hash.ts for byte and hexadecimal conversions.

Tests

Updated tests in chain.test.ts to accommodate changes in queryChainIdWithRest and the removal of the go function.

Chores

General updates to module exports in modules.md, including new variables and functions.

Conflicts


Schema.Trim result in a Parsing Error when using Schema.Class and Schema.TaggedClass with "new" and "make" constructors

What version of Effect is running?
3.5.6
What steps can reproduce the bug?
When using Schema.Class or Schema.TaggedClass:
export class SomeForm extends Schema.TaggedClass<SomeForm>()("SomeForm", {
  userName: pipe(Schema.String, minLength(3), Schema.compose(Schema.Trim)),
}) {}

//the decode is successful here and so it's trimmed:
console.log(
  "%o",
  Schema.decodeEither(SomeForm)({
    _tag: "SomeForm",
    userName: " Jan Damme ",
  }),
)

//however here it result in a Error:
// console.log(
//   "%o make",
//   SomeForm.make({
//     userName: " Jan Damme ",
//   }),
// )
// console.log(
//   "%o new",
//   new SomeForm({
//     userName: " Jan Damme ",
//   }),
// )

What is the expected behavior?
It should properly decode and trimmed the userName values when using both "new" and "make" constructors.
What do you see instead?
a ParseError
Additional information
Tested with both:
@effect/schema 0.68.26
@effect/schema 0.69.1
No response

That's expected, here's the definition of Trim
export class Trim extends transform(
  String$,
  Trimmed,
  { strict: true, decode: (s) => s.trim(), encode: identity }
).annotations({ identifier: "Trim" }) {}

The target of the transformation is Trimmed and SomeForm.make expects a value conforming to that


Support running hermit from different environments

Right now, an active Hermit environment will run binaries (via hermit exec) from another Hermit environment. However, a few corner cases are missing:

The environment of the executed binary is inherited from the user's current environment, as opposed to matching its own environment (as in normal operation).
Commands like hermit env return misleading results, as they use a different environment than hermit exec

Practically, this means the following now works: (notice b/bin and a/bin in the PATH)
% source a/bin/activate-hermit
Hermit environment /Users/ssr/dev/x/a activated
a🐚 % b/bin/hermit env
HERMIT_BIN='/Users/ssr/dev/x/b/bin'
HERMIT_ENV='/Users/ssr/dev/x/b'
PATH='/Users/ssr/dev/x/b/bin:/Users/ssr/dev/x/a/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin'

Whereas right now, the following happens: (notice only a/bin appears in the PATH)
% source a/bin/activate-hermit
Hermit environment /Users/ssr/dev/x/a activated
a🐚 % b/bin/hermit env
HERMIT_BIN='/Users/ssr/dev/x/a/bin'
HERMIT_ENV='/Users/ssr/dev/x/a'
PATH='/Users/ssr/dev/x/a/.hermit/go/bin:/Users/ssr/dev/x/a/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin'

(This reverts commit d38470166e5299c7f9ce6958f099f2db160c0f3e.)

This seems like the right thing to do regardless, but can you add context to the PR/commit on why this fixes the bug we observed?

This seems like the right thing to do regardless, but can you add context to the PR/commit on why this fixes the bug we observed?

Done!

LGTM!


Error running lorri with nix 2.6.0 on darwin

Describe the bug
lorri shell --shell-file .shell.nix failing to build with error
lorri shell --shell-file .shell.nix
lorri: building environment... done
Feb 11 09:14:08.729 ERRO Build failed. No cached environment available.
Build error: Nix process returned exit code 1.
$ "nix-build" "--out-link" "/var/folders/zn/gkkzshhs4d7gnb13bms0mg5m0000gn/T/.tmpMLvZ9Y/result" "--" "/var/folders/zn/gkkzshhs4d7gnb13bms0mg5m0000gn/T/.tmpjzOeZc/result"
error: syntax error, unexpected ',', expecting ')'

       at /nix/store/65zpf8c3p178ynxnyvhxm2iz8kbji87b-lorri-keep-env-hack-tapestry.drv:1:15:

Additionally the same error show up when I enter the directory as I use direnv
Feb 11 09:01:41.287 INFO build status, message: BuildEvent(Started { nix_file: NixFile(AbsPathBuf("/Users/my/git/dev/coolname/.shell.nix")), reason: PingReceived })
Feb 11 09:01:45.925 INFO build status, message: BuildEvent(Failure { nix_file: NixFile(AbsPathBuf("/Users/my/git/dev/coolname/.shell.nix")), failure: Exit { cmd: "\"nix-build\" \"--out-link\" \"/var/folders/zn/gkkzshhs4d7gnb13bms0mg5m0000gn/T/.tmpn31i5Y/result\" \"--\" \"/var/folders/zn/gkkzshhs4d7gnb13bms0mg5m0000gn/T/.tmpThuRrd/result\"", status: Some(1), logs: [LogLine("error: syntax error, unexpected \',\', expecting \')\'"), LogLine(""), LogLine("       at /nix/store/65zpf8c3p178ynxnyvhxm2iz8kbji87b-lorri-keep-env-hack-tapestry.drv:1:15:")] } })

The above error only started when I upgraded to nix 2.6.0. I use direnv with lorri, however I get the same error, even when trying a lorri shell
To Reproduce
My current setup is as follows

Install direnv
install nix version 2.6.0, experimental flake support is NOT enabled.(I use a separate wrapper nixFlakes for that`
Create a folder mkdir lorri_test
Create a .envrc with something like

eval "$(lorri direnv --shell-file .shell.nix)"
eval "$shellHook"
unset PS1
PATH_add ./.idea

Create a .shell.nix with something like

{ pkgs ? import <nixpkgs> {system = "x86_64-darwin";}, ...}:

with pkgs;

let
  inherit (darwin.apple_sdk.frameworks) CoreServices ApplicationServices Security;
  darwinPackages = [ CoreServices ApplicationServices Security ];

  nodejs = nodejs-12_x;

in mkShell rec {
  name = "tapestry";

  buildInputs = [
    nodejs
    (yarn.override { inherit nodejs; })
  ] ++ darwinPackages;

  shellHook = ''
    # Add additional folders to to XDG_DATA_DIRS if they exists, which will get sourced by bash-completion
    for p in ''${buildInputs}; do
      if [ -d "$p/share/bash-completion" ]; then
        if [ -z ''${XDG_DATA_DIRS} ]; then
          XDG_DATA_DIRS="$p/share"
        else
          XDG_DATA_DIRS="$XDG_DATA_DIRS:$p/share"
        fi
      fi
    done

    NODE_ENV=development

    source ${bash-completion}/etc/profile.d/bash_completion.sh
  '';
}

run direnv allow in the folder
watch lorri logs

Expected behavior
lorri builds
Metadata
$ lorri info --shell-file .shell.nix
lorri version: 1.5
GC roots do not exist. Has the project been built with lorri yet?

$ uname -a
Darwin My-MacBook-Pro 21.3.0 Darwin Kernel Version 21.3.0: Wed Jan  5 21:37:58 PST 2022; root:xnu-8019.80.24~20/RELEASE_ARM64_T6000 arm64 arm Darwin

Additional context
I've tried clearing out all lorri cache, nix cache, restarting etc. Running a nix-shell .shell.nix or even a nix shell -f .shell.nix
sudo nix-collect-garbage && nix-collect-garbage && sudo nix-store --verify --check-contents --repair &&  sudo nix-store --optimise

I tested this same scenario inside a linux container running nix 2.6.0 and am NOT seeing the same issue. It appears to be specific to OSX

I have the same issue after upgrading nix. nix-shell works fine but lorri chokes:
🐟 lorri shell --shell-file ../shell.nix                                                                                oasys
lorri: building environment.... done
Feb 16 10:07:53.288 ERRO Build failed. No cached environment available.
Build error: Nix process returned exit code 1.
$ "nix-build" "--out-link" "/var/folders/s_/qdwr96yj3zv0vy21sdzzlx3m0000gn/T/.tmp0zAx9R/result" "--" "/var/folders/s_/qdwr96yj3zv0vy21sdzzlx3m0000gn/T/.tmpsVsKBI/result"
error: syntax error, unexpected ',', expecting ')'

       at /nix/store/f0zbb12xlk0hhx3l44xz4gv98ynw31vk-lorri-keep-env-hack-nix-shell.drv:1:15:

🐟 head  /nix/store/f0zbb12xlk0hhx3l44xz4gv98ynw31vk-lorri-keep-env-hack-nix-shell.drv:

Derive([("out","/nix/store/dabpckpi3wa5cd689pzkj3rshm92igca-lorri-keep-env-hack-nix-shell","","")],
………

I tried this on nix 2.6.1 and the issue appears to be resolved, albeit I'm seeing lorri crash occasionally, which hasn't been the norm for me.


Removed unused tables from materialscommons database

There are old unused tables in the database that could be deleted. It would also require updating dbcreate.py to not build the tables and indices.
A preliminary list of tables to delete include:
Note: This is for the materialscommons database and not the mcpub database.
comment2item
machines (might want to keep for future reintroduction)

note2item
notes
review2item
reviews
runs
tag2item
tags
ui
usergroups

@gtarcea I would like to be able to check and determine that a table is being used. Where do I need to look? Is this sufficent? Search "all *.js in backend and all *.py in backend" for TableName?

Yes. Search for .table
Sent from my iPhone

On Jul 20, 2017, at 8:49 AM, Terry Weymouth<EMAIL_ADDRESS>wrote:
@gtarcea I would like to be able to check and determine that a table is being used. Where do I need to look? Is this sufficent? Search "all *.js in backend and all *.py in backend" for TableName?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.


Better one-liner.

^

Are git.io links read-only once created?

Yes, but https://raw.githubusercontent.com/mrowa44/emojify/master/emojify remains constant in our case.

My concern was security rather than the constancy of the raw download link.

Also, uhh… the instructions you've provided don't work. I'll leave it as an activity to the reader to figure out why.

Should also note that git.io supports HTTPS.

This is just a setup script and a shorter URL will always be easy to remember

Did you actually try doing curl http://git.io/emojify?

Yes, we get the desired bash script.

Really? Comes up blank for me. What's your curl version?

$ curl --version
curl 7.37.1 (x86_64-apple-darwin14.0) libcurl/7.37.1 SecureTransport zlib/1.2.5
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps pop3 pop3s rtsp smtp smtps telnet tftp
Features: AsynchDNS GSS-Negotiate IPv6 Largefile NTLM NTLM_WB SSL libz

@mrowa44 @auscompgeek curl -L http://git.io/emojify work beautifully for me.


FSharp: use int[] instead of Stack for faster access

Turns out that dotnet runtime generates faster code for accessing array<int> than Stack<int>

Note:
I dared to rename the project from fsharp.fsproj to fsharp_con.fsproj to make it easier to find my way around in source code editor.
I hope that is ok.

Very insightful, this halves the time on my device.


Add more suggestions on how to deal with excluding a package from a workspace.

Closes #5418

r? @Eh2406
(rust_highfive has picked a reviewer for you, use r? to override)

@bors: r+

:pushpin: Commit d7a92124099145b87eb2133c4b18990d4c66e2a5 has been approved by alexcrichton

:hourglass: Testing commit d7a92124099145b87eb2133c4b18990d4c66e2a5 with merge c1384e831da7d65d1579ba00fed984b2eeec33a2...

:sunny: Test successful - checks-travis, status-appveyor
Approved by: alexcrichton
Pushing c1384e831da7d65d1579ba00fed984b2eeec33a2 to master...