Improve search widget for image data

Feb 24 2022: currently using vector search.

Image search is rather unclear compared with text. Things to consider:

what kind of Bokeh widget to use. Could be FileInput for uploads or TextInput for urls
what kind of search is appropriate (as in, making semantic sense and trying to be independent from the vectorizer/dimensionality reduction)

look into Structural Similarity
more research would be helpful

More on image matching

Work in progress: first implement a vector-based search. Then try to upgrade to structural similarity.
If structural similarity works well, we can do the same for audio in its MFCC format.

Update: consider an abstract vector search engine, or an abstract similarity-based search engine.

Hi, I'm using hover to annote a dataset of image, and I encounter a small issue regarding the visualization of the image.
If the resolution is higher than the row width or row height define for the table we don't visualize very well.
To fix this you can just change in hover/core/local_config.py Line 60:
template="""<img src=<%= value %>>""",
To:
template="""<img src=<%= value % width="200" height="200">>""",
It will automatically resize the image in a 200x200 and so you can see image with for instance a resolution of 720x720
I can do a PR for that if you want but the modifications is very small

Hi, @FlorianBertonBrightClue thank you for using hover and bringing this up!
In some use cases 200x200 can be difficult to see clearly. Actually we can make it configurable on the user side.
The code below should work for the upcoming 0.8.0 version, which is likely within a week.
hover.config["visual"]["table_image_width"] = 200
hover.config["visual"]["table_image_height"] = 200

Does this look good?

And so at line 57/58 in local.config.py, you will put this ?
feature_col_kwargs["formatter"] = HTMLTemplateFormatter(
template=f'<img src=<%= value %> width="{hover.config["visual"]["table_image_width"]}" height="{hover.config["visual"]["table_image_height"]} >',
)
If yes, it should work and the user could configure it as ha wants by setting the hover.config.
I also have two questions for you :

It seems for now that we can't set the parameters for the DimensionalityReducer, would it be possible later ? Like for instance in umap you can choose the number of neighbor or the minimum distance.

Can we change the label for data that are already in train ? In my case I did some prelabelling and sometimes I want to change the label because two clusters are close one to each other and finally and want to merge them together

And so at line 57/58 in local.config.py, you will put this ? feature_col_kwargs["formatter"] = HTMLTemplateFormatter( template=f'<img src=<%= value %> width="{hover.config["visual"]["table_image_width"]}" height="{hover.config["visual"]["table_image_height"]} >', )

Basically yes. This line reads the config only once though, so be sure to configure immediately after import hover.

It seems for now that we can't set the parameters for the DimensionalityReducer, would it be possible later ? Like for instance in umap you can choose the number of neighbor or the minimum distance.

Technically you can. With dataset.compute_nd_embedding() you can pass in keyword arguments that umap accepts. Hover attempts to “translate” crucial kwargs for compatibility (like “dimension” to different equivalents in umap and ivis) but will forward the rest.
This could be much better documented though.

Can we change the label for data that are already in train ? In my case I did some prelabelling and sometimes I want to change the label because two clusters are close one to each other and finally and want to merge them together

You can do this a few ways depending on which one is convenient:

in the selection table (the one where large images don’t show well right now), make edits in the label column and save the edits.
access the underlying dataframe with dataset.dfs["train"].
export to file, edit and load back.

You cannot change train labels directly the same way you label raw data in the scatter plot. “Commit” locks in the subset and label unless you take the “backdoors” above. This is to prevent mis-relabeling labeled data that happen to be (for good reasons) mixed into in a selection.


Input value clash with Label on init

hi there,
thanks for your hard work to get some beer in the game :D
i found this on init, an input with filled value:

And this if a label has whitespace:

cheers

Hum, I will investigate it. Do you call ui() after html output?
All best!

Hi @dutscher ,
I'm trying to investigate this behavior with Svelte here https://codesandbox.io/s/label-up-svelte-beercss-lmfmi4
Any change on label (and this includes a re-render like if) you need to call ui() after tick(). This occurs because beercss needs to update the clip-path property based on text size of the label . This behavior applies to field element  with border helper only.
Hope this helps, you!

I will close this issue, ok? Anyway I fixed a label ratio issue here too https://github.com/beercss/beercss/releases/tag/v2.0.16.
And feel free to reopen this issue at anytime.


__WB_MANIFEST returns an empty array

Hi! i have this weird issue where __WB_MANIFEST in service worker file shows an empty array after build and doesn't even include index.html.
im using vite with react and react router v6.  tested it in both development and production mode and it works on production so the problem is only development mode. followed demonstration inside example folder and nothing changed. i hope you can help me fix this weird issue. ( im new to this whole pwa things sorry if its a dumb question :) )
here is my vitePWA config :
mode: 'development',
injectRegister: 'auto',
devOptions: {
      enabled: true,
       type: 'module',
},
includeAssets: ['favicon.ico'],
strategies: 'injectManifest',
srcDir: 'src/',
filename: 'sw.js',
scope: '/',
base: '/',
registerType: 'autoUpdate',
manifest: {
	name: 'sth',
	short_name: 'sth',
	description: 'sth',
	background_color: '#000',
	theme_color: '#000',
	scope: '/',
	id: '/',
       start_url: '/',
},
injectManifest: {
	swSrc: 'src/sw.js',
	swDest: 'sw.js',
	globDirectory: 'dist',
	globPatterns: ['**/*.{js,css,html,png,jpg,jpeg,gif,svg}', 'index.html'],
},
workbox: {
	navigateFallback: 'index.html',
	swDest: 'sw.js',
},

Move injectManifest entry to root pwa plugin options, it is not a manifest property, it is a pwa plugin option.

@userquin thanks for the quick response. it was a mistake when I was trying to copy & paste it here.it is correct inside the original file.

try removing this entries from the injectManifest option:
swSrc: 'src/sw.js',
swDest: 'sw.js',
globDirectory: 'dist',


can i train bevfusion with kitti dataset

Thank you for the author's contribution ：）
Can I train bevfusion with kitti dataset？？？？

Yes it is also possible, but probably you will have to implement the dataloaders for KITTI by yourself. There might be some references from mmdet3d that could be very helpful, but I am not very familiar with it.

I want to test and evaluate bevfusion with kitti dataset. then i don't have to change anything?  maybe it is little bit silly question for you... i just want to confirm it.

@Baron6977
Hello,  I meet the same problem with you, may I ask if you were successful?

Hello, I meet the same problem with you, may I ask if you were successful?

Hello, I meet the same problem with you, may I ask if you were successful?

@Baron6977 Hello, I meet the same problem with you, may I ask if you were successful?

i can

Hello, I meet the same problem with you, may I ask if you were successful?

sure

@liuyuansheng624<EMAIL_ADDRESS>联系我.

@Baron6977 Hello, I meet the same problem with you, may I ask if you were successful?

i can

Hello! How about the performance in the KITTI (compared to the Voxel-RCNN)? Would you share the evaluation? Thanks!

you can  wechat<PHONE_NUMBER>6 for me
发自我的iPhone
------------------ Original ------------------
From: weilli @.>
Date: Sun,Dec 17,2023 10:08 PM
To: mit-han-lab/bevfusion @.>
Cc: liuys @.>, Mention @.>
Subject: Re: [mit-han-lab/bevfusion]  can i train bevfusion with kitti dataset(Issue #349)

Hello, I meet the same problem with you, may I ask if you were successful?

hello! Have you succeeded, please！

加我微信13731082126
发自我的iPhone
------------------ Original ------------------
From: chen @.>
Date: Tue,Apr 9,2024 7:06 PM
To: mit-han-lab/bevfusion @.>
Cc: liuys @.>, Mention @.>
Subject: Re: [mit-han-lab/bevfusion]  can i train bevfusion with kitti dataset(Issue #349)
Hello, I meet the same problem with you, may I ask if you were successful?
hello! Have you succeeded, please！
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: @.***>


UCP: Add form validation for log searching page

Description
Add form validation for log searching page. In search form, we should do some validation before send request to back-end. e.g. at least 1 component should be selected. When download logs, at least 1 finished task should be selected.
Score

50

Mentor(s)

@Deardrops

Contact the mentors: #tidb-challenge-program channel in TiDB Community  Slack Workspace
Recommended Skills

Web programming, includes

Typescript
React (React Hook)

Will be resolved by ourselves.


integrate alerting with security-analytics for integ tests

Signed-off-by: Subhobrata Dey<EMAIL_ADDRESS>Description
integrate alerting with security-analytics for integ tests
Issues Resolved
[List any issues this PR will resolve]
Check List

[ ] New functionality includes testing.

[X] All tests pass

[ ] New functionality has been documented.

[ ] New functionality has javadoc added

[X] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Closing in favor of https://github.com/opensearch-project/security-analytics/pull/21


Fixed bugs in layout, text, and options

Changed Gender stratagy to Sex Stratagy
Changed Manipulators from # field to text line
Removed unexpress accents from Melee
Added zero line associations
removed home port from associations
Fixed Supply and Complex material from part of a tonne to a tonne per unit

Hi @XophRA, because you're changing attribute names, please provide a sheet worker to convert from previous ones, otherwise users of the sheet will lose data.  Additionally, I'm not sure how this game works, but we have a strict policy regarding Gender on our character sheets, so I'd ask that you please update the sheet to follow the guideline specified here: https://wiki.roll20.net/Building_Character_Sheets#A_Small_Request_for_Character_Sheet_Authors
Until this in particular is resolved, this sheet will have to be removed from the one-click list.
Thank you,
Jeff

Hi @Solarswordsman ,
I am unsure how to make a sheet workers, but as my game is unpublished and only four people currently have preview copies, loss of data should not be an issue.
As for the Gender policy, the sheet already fulfils the policy. It has a Gender Identity text field in the description area. The changes I added were to the summary of the alien species. Sex Strategy list whether the species is dimorphic, monomorphic, et cetera. I also altered the Sex field which allowed you to choose a single biological sex to the sexes field, so that you can choose a list the biological sexes for the species. Example: a trimorphic species would have a displayed list of Female, male, neuter. I believe this better fits your policy.


what is "mechanics domain" ontology?

thank you @francescalb and @jesper-friis  for the Readme file. It is not clear what do you mean with the mechanics domain ontology? is it mechanical testing? would you please clarify this also in the Readme file. Thanks.

also, note that when one clicks on the link shown in the list of submodules, mechanics leads to "Not Found".

Hi Adham, it was mechanical testing, but not sure if we need that anymore. Must check this.


[Feature Request] Add support for darwin-arm64

Thank you!

Thanks for raising feature request.
Currently there is no darwin-arm64 asset in tokei releases.
When darwin-arm64 asset is ready in upstream I will add support for it.
Thanks.

Currently there is no darwin-arm64 asset in tokei releases.

Yep, there is an issue https://github.com/XAMPPRocky/tokei/issues/724

And there is a pre release : https://github.com/XAMPPRocky/tokei/releases/tag/v13.0.0-alpha.0

For now it uses tokei-x86_64-apple-darwin.tar.gz archive :
nicolas@MacBook-Pro-de-Nicolas:~/.asdf/installs/tokei/13.0.0-alpha.0/bin$ file tokei
tokei: Mach-O 64-bit executable x86_64

and it works :)


Add ability to create sub-folders

This is already saving me a ton of time, but it's still a 2-step process:

Right click, New Folder, enter name
Right click, New File from Template, enter name

I thought MAYBE I could get away with the setup below, but when I use New File from Template, nothing happens now, so I assume it's not supported:

If that worked, I could just do step #2 above and it'd create the sub-folder for me.
PS: This thing is amazing, thanks to everyone involved.

This is a good idea - recursively create all the folders!. It should be possible.
Just to double check something - in the folder example you gave. Would we need to check if that 'component' folder is already created - and if it is just skip creating it and put the subfolder in the existing 'component' folder? Or would you expect it to be recreated every time?

Good question...
Personally, for this 1 scenario, if the folder already exists and has files/folders in it, I'd prefer it to just error out, letting me know it can't be created because it exists and isn't empty.  If it exists but is empty, then I don't see a problem just proceeding.
Although I imagine someone might have a scenario where they don't care about existing files/folders and just want to merge the new stuff in (maybe even overwriting any existing files).
How hard is it to prompt when files exist?
File "xxx.html" exists.  Overwrite?

[Overwrite] [Overwrite All] [Cancel]

Actually... I think we already have your case covered with the createFilesInFolderWithPattern option of the manifest.json file (Originally I was thinking you wanted to create the "Component" folder and the kebabCase_name folder).
Create a manifest.json file in your template folder with something like:
{
"createFilesInFolderWithPattern": "kebabCase_name"
}
This option is a bit hidden away though.
But... I just checked in something that will make it so what you have also works. It should also allow for nested folders of any depth.
Should be able to release it soon. Thanks!
P.S. I'd love for you to submit a pull request at https://github.com/reesemclean/blueprint-examples with you template(s). It would be great to expand that so that everyone could see how to do different things with it.

Version 1.3.0 with the ability to template folder names is now available! Thanks for the request!

Works like a charm without the manifest.json settings.  Thank you!


When monitor metric size >1 fallback to save_best_only=False in ModelCheckpoint

When we use F1_score with average=None as monitor for Model checkpoint and the model is of multi-class classification problem then the metric returns f1_score of each class. In such scenario if save_best_only=True passed to ModelCheckpoint then it will raise an error due to ambiguity.
ValueError: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()
If we set save_best_only=False which is default then there is no problem with model checkpointing. Hence I am proposing to fall back to save_best_only=False mode and display it as user warning for such case instead raising an exception.
Attached gist for the same with testing the fix.
May Fix the TF ticket #61336.

Codecov Report
Attention: 3 lines in your changes are missing coverage. Please review.

Comparison is base (088f0fc) 80.02% compared to head (ac070cb) 56.96%.

Files
Patch %
Lines

keras/callbacks/model_checkpoint.py
0.00%
3 Missing :warning:

Additional details and impacted files
@@             Coverage Diff             @@
##           master   #19117       +/-   ##
===========================================
- Coverage   80.02%   56.96%   -23.07%
===========================================
  Files         341      341
  Lines       36119    36122        +3
  Branches     7109     7110        +1
===========================================
- Hits        28904    20576     -8328
- Misses       5611    14051     +8440
+ Partials     1604     1495      -109

Flag
Coverage Δ

keras
56.96% <0.00%> (-22.91%)
:arrow_down:

keras-jax
?

keras-numpy
56.96% <0.00%> (+0.01%)
:arrow_up:

keras-tensorflow
?

keras-torch
?

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

If the proposal is OK then I can modify the code to fix the failing tests.


Asif8240233397

numpy cmplt

Read the questions carefully, some solutions are missing. Few needs improvements required e.g - cyclic means<PHONE_NUMBER>2...


Reading XYZ file crashes from Python

Is there a different repo for Python issues?
I'm using 0.9.1 of chemfiles from conda-forge on an osx machine and this happens:
In [1]: import chemfiles

In [2]: chemfiles.Trajectory('water.xyz', 'r', 'XYZ')
libc++abi.dylib: terminating with uncaught exception of type std::invalid_argument
Abort trap: 6

where water.xyz is
3
water
H            9.625597       6.787278      12.673000
H            9.625597       8.420323      12.673000
O           10.203012       7.603800      12.673000

Is there a different repo for Python issues?

There is https://github.com/chemfiles/chemfiles.py, but this seems to come from C++ side.
This error looks a lot like C++ ABI issue we already had: when compiling chemfiles with a given C++ standard lib and then running it with another, try/catch does not work since the typeid of exception changes =/
But I have never seen this on osx, only on Linux with the GCC 5 new C++11 ABI. What version of macOS are you using?

@Luthaf I think it's the most recent, 10.14.5.  Tbh I think conda(-forge) is meant to build to prevent these sorts of things, maybe it's a recipe issue?
Configured with: --prefix=/Library/Developer/CommandLineTools/usr --with-gxx-include-dir=/Library/Developer/CommandLineTools/SDKs/MacOSX10.14.sdk/usr/include/c++/4.2.1
Apple LLVM version 10.0.1 (clang-1<IP_ADDRESS>)
Target: x86_64-apple-darwin18.6.0
Thread model: posix
InstalledDir: /Library/Developer/CommandLineTools/usr/bin

Ok, that's weird ... I am also on macOS 10.14.5, and I can't reproduce this crash =/
What would be the output of otool -L <CONDA_PREFIX>/lib/libchemfiles.0.9.1.dylib?
And if you can get a backtrace of the crash with lldb for example that could help.

On my machine, conda list gives libcxx and libcxxabi version at 8.0.0, build 4. Do you have the same?

@Luthaf yeah maybe that's the difference:
# packages in environment at /Users/richardgowers/miniconda3/envs/mda:
#
# Name                    Version                   Build  Channel
libcblas                  3.8.0                4_openblas    conda-forge
libcurl                   7.62.0               h051b688_0
libcxx                    4.0.1                h579ed51_0
libcxxabi                 4.0.1                hebd6815_0

Do you have conda-forge first in ~/.condarc? that could be the origin of the issue

@Luthaf
  - conda-forge
  - defaults
channel_priority: flexible

from a quick look at the conda recipes, it might be that you need the cxx in the run requirements too?

Maybe, I'll have a look!

Let's move the issue over to https://github.com/conda-forge/chemfiles-lib-feedstock/issues/27


When showMultiDayTimes: true events ending next day are showing as all-day events

Which is not what I want.
I just want what fullCalendar.js does:

I don't think there is anything currently like that, am I wrong?
Originally posted by @decoursin in https://github.com/intljusticemission/react-big-calendar/issues/363#issuecomment-349879731

I just tested this in 0.19.0 and it seems to be working. Can you confirm this is still an issue?

If 0.20.1 is the version installed on demo page than yes, it is still an issue

In that example photo I believe the 7:30pm - 2am is displaying correctly. Can you describe how you would expect it to be displayed?

Oh ok, so you are saying you would expect to see the text '7:30pm - 2:00am' in both days event blocks, instead of '7:30pm -' and '- 2:00am'?

Exactly :) I've checked it now on google calendar an they have also like this.

Looking at the code, this functionality seems very much intentional. It doesn't look like there is any kind of label accessor that would allow you to override it. Perhaps @jquense would have a better idea.

Any update on this issue?

Any update on this issue?

I'd like to have this too, thanks

this seems to work now in 1.11.x


Need to use bbr.yml in boshlite creation

In boshlite setup, generally deployment runs inside of director.  I tried to update the director with create-env command(for bbr.yml) and deployment got affected, I was pretty sure about it. Its really painful. My suggestion is that somebody should update the documentation to include this bbr.yml file in bosh creation command as well. I remember, earlier this job was already included. Bosh backup should be part to bosh.io.
Just a suggestion.

Hi @arpitvipulsharma,
BOSH Lite is intended to be used as an ephemeral development workflow, and is not equipped to support production style workloads. For these reasons, we don't plan on adding the bbr.yml to the BOSH Lite documentation as in general users shouldn't be backing up and restoring their BOSH Lite environments. Sorry for the inconvenience. Let us know if you have any further questions.
Best,
@jfmyers9 && @belinda-liu, CF BOSH


simplify ci

Closing, superseded by https://github.com/codex-storage/nim-codex-dht/pull/66 and https://github.com/codex-storage/nim-codex-dht/pull/67. Though there's definitely still room to simplify the CIs.


How to specify Resizable component on onResize function ?

[ ] Bug
[ ] Feture Request
[x] Question

Problem Report
Hi,
I am beginner for React though,
I would like to know how to specify the object which is resizing on onResize function
when the React.Component has multiple Resizable components.
onResize handler seems pass event, node and size as arguments in the current implementation,
however, I could not specify the object which is resizing on onResize handler.
To solve this problem, I forked this repo then add new commit on my side.
https://github.com/yayoc/react-resizable/commit/52405a536e7c2f0e0fb6962fbba7915900d4e13c
I'm not sure this implementation is a better way.
Please let me know what your idea about this.
If this commit is satisfied your idea, I will create PR.
Thanks.

Hi - no, you want to do something like this:

onResize(id, event, node, size) {
  // ...
}

render() {
  return (
    <div>
      <Resizable onResize={this.onResize.bind(this, 1)} ... />
      <Resizable onResize={this.onResize.bind(this, 2)} ... />
    </div>
  );
}

@STRML Thanks!


Test: Transition PAAPI parameters

🔧 Type of changes

[ ] new bid adapter
[ ] bid adapter update
[ ] new feature
[ ] new analytics adapter
[ ] new module
[ ] module update
[ ] bugfix
[ ] documentation
[ ] configuration
[ ] dependency update
[ ] tech debt (test coverage, refactorings, etc.)

✨ What's the context?
What's the context for the changes?
🧠 Rationale behind the change
Why did you choose to make these changes? Were there any trade-offs you had to consider?
🔎 New Bid Adapter Checklist

[ ] verify email contact works
[ ] NO fully dynamic hostnames
[ ] geographic host parameters are NOT required
[ ] direct use of HTTP is prohibited - implement an existing Bidder interface that will do all the job
[ ] if the ORTB is just forwarded to the endpoint, use the generic adapter - define the new adapter as the alias of the generic adapter
[ ] cover an adapter configuration with an integration test

🧪 Test plan
How do you know the changes are safe to ship to production?
🏎 Quality check

[ ] Are your changes following our code style guidelines?
[ ] Are there any breaking changes in your code?
[ ] Does your test coverage exceed 90%?
[ ] Are there any erroneous console logs, debuggers or leftover code in your changes?

Corresponding issue https://github.com/prebid/prebid-server/issues/3536


Makes the application also be usable as a library.

Adds a koino.zig file that imports the stuff used in main.zig, adds workaround for memoization

Thank you so much! 🙏


README/docs: Clarifying xpath version changedetection.io uses

lxml uses xpath 1.0

lxml supports XPath 1.0, XSLT 1.0 and the EXSLT extensions through libxml2 and libxslt in a standards compliant way.

Therefore newer xpath syntax cannot be used. (such as "matches").

See also SO answer

@Constantin1489 ah yes! also good catch, any experience with https://github.com/dgtlmoon/changedetection.io/issues/1631#issuecomment-1598495509 ?

I actually learning xpath recently.
So, I'm sorry but that.
It seems elementpath might be helpful. I saw Saxonc's solution on SO but it's commercial.


Updating package.json version and Readme details

Looks like the build is failing because of npm audit. Can you resolve the dependencies by running npm audit fix?


storage: refactor pkg/storage

Describe the bug
Currently, we have modeled different storage backends as completely independent modules. However, most of the code is identical (investigate if this is true), so perhaps refactor as common code and backend-specific code.

Create a single ImageStore with different Backend. Remove the pkg/storage/storage.go interface.
`
type ImageStore stuct {
...
BackingStore *driver
...
}
type Cache struct {
...
BackingStore *driver
...
}
`

Analyze the code carefully though.

Also evaluate if we add more cloud backends, would this refactor be detrimental?

Couldn't use the storage driver for filesystem, there are a lot of places where things are done differently. Let's say that this can be solved, but the storage driver use file.Sync() and file.Flush() at every write, and from my understanding we don't want that, currently we have a 'commit' flag in the config for this.


CLI should validate the URL input.

The URL and parameters in the CLI command are not properly validated.
Case 1: Even after entering an incorrect URL, the site still continues to be analyzed without proper validation.

Case 2: When the parameter is invalid in the command, it prompts a message stating that the provided URL is not valid. It should show proper message.

[ ] If the CSV file contains only a single page URL, the CLI should proceed to analyze the URL directly, rather than prompting for the number of pages to analyze.

hey @milindmore22
I'm testing the recent update to support port options from #573 and I'm still having this issue with the CLI.
npm run cli -- -po 10000 -u https://www.bbc.com

><EMAIL_ADDRESS>cli
> node dist/cli/index.js 10000 https://www.bbc.com

Please provide one and only one of the following
        a) URL of a site (-u or --url)
        b) URL of a sitemap (-s or --sitemap-url)
        c) Path to a CSV file (-c or --csv-path)
        d) Path to an XML file (-p or --sitemap-path)

My Windows 11 machine seems to be not properly handling the -po part


Improve usage docs

When getting started I had to look into the code to understand the queue and how to pass parameters, I also saw that more people had a similar situation https://github.com/watson/worker-threads-pool/issues/5
This PR improves the documentation adding a usage example without the for complexities and explains the queueing process.

Just getting to this one now. Reading the diff, I can't really see what new code example is adding compared to the existing one?

My goal was to simplify the example and show the workerData parameter but I'm fine in closing it if you think it's not going to help.


Local game crashes after 1 minute after character transfer from server

Hey @deafdudecomputers, first of all, thanks for creating the tool.
I'm following up on your message here: https://github.com/xNul/palworld-host-save-fix/issues/191#issuecomment-2382304816
I tried again today with the latest version of your tool v0.8.8 , the latest version of python python-3.13.0-amd64 and Visual C++ Redistributable v0.84.0 installed, and was able to run the script properly, and start my save with my character.
For context, I'm trying to move from a G-Portal server to a local save.
Things seem to mostly work, I'm able to start my game with my character, but after what seems to be exactly 1 minute of gameplay (first auto-save?), the game crashes and opens the Pal Crash Reporter with this message:
A process has crashed: UE-Pal
EpicAccountId:<redacted>

Unhandled Exception: EXCEPTION_ACCESS_VIOLATION reading address 0x0000000000000000

Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
Palworld_Win64_Shipping
kernel32
ntdll

Have you ever experienced this? Any ideas what might be happening? I can provide my files for testing if you'd like.

Other small Inconveniences:

The map is no longer discovered, and I don't seem to have any TP (apart from my bases), is that expected?
Tutorials seem to have reset and it's showing me tooltips (really not a problem, just sharing)
Haven't found anything else minor, but I can't play more than a minute

Logs of running the script:
> .\fix_host_save.cmd
Found Python at C:\Program Files\Python\Python313\python.exe
Python Version: Python 3.13.0
Executing fix_host_save.py using C:\Program Files\Python\Python313\python.exe...
Save Path: C:\Users\<username>\workspace\PalworldSaveTools.v0.8.8\LocalWorldSave\Level.sav
Running: "C:\Program Files\Python\Python313\python.exe" "fix_host_save.py"
Attempting to ensure pip is installed...
Pip installed successfully.
Attempting to find msgpack...
msgpack not found. Installing...
msgpack installed successfully.
Attempting to find palworld_coord...
palworld_coord not found. Installing...
palworld_coord installed successfully.
Attempting to find psutil...
psutil not found. Installing...
psutil installed successfully.
Attempting to find palworld_save_tools...
palworld_save_tools is already installed.
Attempting to find matplotlib...
matplotlib not found. Installing...
matplotlib installed successfully.
Attempting to find pandas...
pandas not found. Installing...
pandas installed successfully.
Attempting to find cityhash...
cityhash not found. Installing...
cityhash installed successfully.
Downloading and extracting assets...
Enter new GUID:<PHONE_NUMBER>0000000000000000000001
Enter old GUID: 051E0699000000000000000000000000
WARNING: Running this script WILL change your save files... Backup recommended.
Press enter to continue...
Converting LocalWorldSave\Level.sav to JSON
Decompressing sav file
Loading GVAS file
Attempting to ensure pip is installed...
Pip installed successfully.
Attempting to find msgpack...
msgpack is already installed.
Attempting to find palworld_coord...
palworld_coord is already installed.
Attempting to find psutil...
psutil is already installed.
Attempting to find palworld_save_tools...
palworld_save_tools is already installed.
Attempting to find matplotlib...
matplotlib is already installed.
Attempting to find pandas...
pandas is already installed.
Attempting to find cityhash...
cityhash is already installed.
Converting LocalWorldSave\Players\051E0699000000000000000000000000.sav to JSON
Decompressing sav file
Loading GVAS file
Modifying JSON save data...
Converting data to SAV, saving to LocalWorldSave\Level.sav
Compressing SAV file
Compressing: 99% completedWriting SAV file to LocalWorldSave\Level.sav
Converting data to SAV, saving to LocalWorldSave\Players\051E0699000000000000000000000000.sav
Compressing SAV file
Writing SAV file to LocalWorldSave\Players\051E0699000000000000000000000000.sav
Fix has been applied! Have fun!
Press any key to continue . . .

Thanks for your time 🙏

Either mods affected the save themselves to a point it breaks? Not sure, but let me know if you had mods installed on old server.
Secondly, did you delete the Players folder and Level.sav on server and replacing with the new Level.sav and Players folder the fix has applied? Just in case, some users didn't do this step correctly and it may cause some errors/etc.

I never used mods no, so no mods on the old server, and no mods on my PC (the destination of the move).
After running the script, I did delete the entire Players folder and the Level.sav under:
C:\Users\<username>\AppData\Local\Pal\Saved\SaveGames\<some_id>\<new_world_id>
Then copied the modified files from the LocalWorldSave into that folder.
Is there anything special to do with LevelMeta.sav, LocalData.sav, and WorldOption.sav that would matter? Keep them, remove them?
I also had disabled Steam cloud save sync for now because it was restoring things on its own when starting the game, I'll keep it disabled until I can get it working.
One more things is we were 3 players on the old server, and so far I'm only migrating my own player to the new ...00001 guid, would it make a difference if I got all 3 of us to create new characters and do all 3 transfers?

Maybe I should just try and run the Palworld Dedicated Server on my machine, maybe I wouldn't need to character transfer? 🤔
I'll give this a try.

The only save that need to be updated is the "host" save. It needs to be converted from regular save into 0001.sav, which is the host save. You only need Players folder and Level.sav. No need for other files such as LevelMeta.sav and etc. They will be automatically generated. However, the WorldOptions.sav will be needed if you don't use PalWorldSettings to set up your world settings. No need to try to "transfer" the new characters for other players. Did you create new character on local save then use that as base for 0001.sav?

I'll attempt the dedicated server transfer to local world myself to see if it's breaking anything. Give me few minutes.

Make a copy of Saved folder from dedicated server(G-Portal/etc). It consists all of information needed.
Make a new world on PalWorld. Name it whatever you want. I'll do the default name, which is Palpagos Islands.
Create your character. Name it whatever you want.
Enter the game.
Walk/Run until you find 2 pieces of wood and then unlock the first fast travel point.
The auto-save typically kicks in within 60 seconds(1 minute) by default. I'd typically wait 5 minutes just to be safe.
Close the game.
Go into (C:\Users\YOURUSERNAME\AppData\Local\Pal\Saved\SaveGames\some_id) and sort by date modified.
Open the folder with latest date modified. Remember the folder name. For me, it's (CD03AEB541DB0F6D6A01B1836B1AACB0).
Copy the 0001.sav from Players folder in that new generated world save.
Paste the 0001.sav file into your dedicated server Players folder.
Copy the dedicated server Players folder and Level.sav.
Paste the dedicated server Players folder and Level.sav into LocalWorldSave in my tool.
Run the tool.
Input 0001.sav as new GUID.
Input old regular save id.sav as old GUID.
Press enter to continue.
Once it said fix has been applied, have fun. Close the tool.
Copy Players folder and Level.sav from LocalWorldSave folder.
 It's mentioned via 9th step.
Paste the Players folder and Level.sav from LocalWorldSave folder. Accept any pop up warning to overwrite files.
Launch the game again.
Enter the world. It may take some time depending on how many bases and pals and etc on server.
It should work.

Hey Pylar,
I gave this another go today following your instructions, but still ended up with my game crashing at the 1 minute mark at the first time the Saving message appears, same as before.
A few things I did try to do differently today by following your updated instructions:

How I created the character:

Before, I used to create/load the local temporary character inside my saved world (copied from the dedicated server, and I could see some old structures at the starting point), and only then copying the files over to LocalWorldSave and executing the script, and then bringing it back.
This time, I created and only loaded the temp character in the new empty world, and then copied only the 0001.sav into LocalWorldSave/Players (as per instructions 2 to 11), alongside my dedicated sever saved files, and only then running the script and moving the result back to the local world (and overwriting things).

Leveling up my temp character to lvl 2 (even lvl 3) and doing a few actions with it (catch first pal)

But like I mentioned, this didn't help, as per my original post, I can load my world and character properly, everything looks fine, and then it crashes after 1 minute.
So this isn't resolved for me, I don't know if it is because of something that G-Portal might have done to the files or what, but I can't get past it whatever I try with generating the world and running the script.
But, I've moved on to a different solution (sharing below), so all good on my end, I'm still happy to share my saved files if you'd care for them, lmk, and thanks for trying.

On my end, I ended up using the Palworld Dedicated Server process (available on steam) and moving my G-Portal save on that setup, no need for temporary character and character transfer with any tool, and that also means I can have just the Palworld Dedicated Server process running locally and my friends joining it, without being inside the game myself, so I think that'll work better for me and my friends.
For people that might find this post, here's how I did it (with inspiration from this guide and the official documentation:

Install Palworld Dedicated Server from Steam
Run it once and wait for it to generate and world and display Running Palworld dedicated server on :8211
Shut it down
Go to the PalServer saved folder, which if you followed default installation should be there (adapt to your situation):

C:\Program Files (x86)\Steam\steamapps\common\PalServer\Pal\Saved\SaveGames\0\<local_dedicated_world_id>

Inside that folder, delete everything, and paste in your files from your previous server (Players folder, Level.sav and LevelMeta.sav. Optionally: backup folder if you want)
Create a PalServer\Pal\Saved\Config\WindowsServer\PalworldSettings.ini file following the guide above and adapting settings to your needs.

One thing you want to update right away is the BaseCampWorkerMaxNum=50 otherwise if you leave at 15, the extra pals from your bases will be dropped in front of the PalBoxes, which is just annoying

Do some port-forwarding on your router to allow friends to connect to your server, I'll let you figure that one out.

One final tip I'll share:

I found out how to transfer the Map discovery data and things like tooltips/indicators progression for your character

That data is saved within the LocalData.sav file which is always stored on your computer (even when using dedicated servers) in C:\Users\YOURUSERNAME\AppData\Local\Pal\Saved\SaveGames\some_id\world_id.

So once you have your servers/local-games running (whichever kind of transfer you're doing), you need to copy over the LocalData.sav:

from C:\Users\YOURUSERNAME\AppData\Local\Pal\Saved\SaveGames\some_id\old_world_id
to: C:\Users\YOURUSERNAME\AppData\Local\Pal\Saved\SaveGames\some_id\new_world_id

Alright, as I finished writing all this and jumped in to take those 2 screenshots, I realized one crucial thing:
⚠ I could not access my privately locked chest, and I wondered if maybe that was the issue.
▶ I went back to my server, disabled all the Private locks on chests, waited for an auto-save, left and used those new save files with the tool's script again, going through the whole process in the same way.
🎉 And turns out this was the issue! I'm now able to play my save world locally, and the game hasn't crashed for a good 20 minutes or more, even after re-enabling the private locks on my chests.
💡 So it seems like the private locks on chests aren't being transferred properly and that's causing the issue.

I wonder if it would've still crashed if I still had the <old_guid>.sav file in the Players folder, but still even in that case, I could never access my chest again, and it can't be deleted either.
So the workaround is to remove private locks on the old save before running the script, then adding the locks back after having successfully migrated the world.
And the solution is to get those locks transferred properly in the tool.

Thanks again for the tool and your help 🙏  Now I have multiple options going forward 👍

Alright, as I finished writing all this and jumped in to take those 2 screenshots, I realized one crucial thing:
⚠ I could not access my privately locked chest, and I wondered if maybe that was the issue.
▶ I went back to my server, disabled all the Private locks on chests, waited for an auto-save, left and used those new save files with the tool's script again, going through the whole process in the same way.
🎉 And turns out this was the issue! I'm now able to play my save world locally, and the game hasn't crashed for a good 20 minutes or more, even after re-enabling the private locks on my chests.
💡 So it seems like the private locks on chests aren't being transferred properly and that's causing the issue.

I wonder if it would've still crashed if I still had the <old_guid>.sav file in the Players folder, but still even in that case, I could never access my chest again, and it can't be deleted either.
So the workaround is to remove private locks on the old save before running the script, then adding the locks back after having successfully migrated the world.
And the solution is to get those locks transferred properly in the tool.

Thanks again for the tool and your help 🙏 Now I have multiple options going forward 👍

That's really interesting to know. So, I'll try to fix this issue and by the meantime, I'll let everyone know to disable private lock on their chests before transferring. Thank you for debugging and appreciate you!


Vulnerability roundup 109: udisks-2.8.4: 1 advisory [4.2]

search, files

[ ] CVE-2021-3802 CVSSv3=4.2 (nixos-21.05, nixos-21.11)

CVE details
CVE-2021-3802
A vulnerability found in udisks2. This flaw allows an attacker to input a specially crafted image file/USB leading to kernel panic. The highest threat from this vulnerability is to system availability.

Scanned versions: nixos-21.05: 3b422991781; nixos-21.11: 573095944e7.
Cc @johnazoidberg

PRs to fix: #150721 #150722

Fixed in 21.11, NixOS 21.05 is EOL.


Go: Add OpenCensus

To really achieve the Level IV Operator Capability level, there should be tracing.
I'm manually adding Jaeger/Opentracing to my operators, but I think it should be implemented directly in operator-sdk and add to the APIs that create children span automatically and let developers implement the sub tracing.
This is a major break in API compatibility. but worth it

Hi @bclermont,
Could you please described what  Jaeger/Opentracing provided which and what do you achieve with it? Also, could you please describe what helper did are you asking here as what is the scenario that was solved with?

I have this operator that is super slow and run in few k8s clusters. I added a tons of logs but sometimes things get sluggish and just by looking at the logs it's very difficult to understand.
By using a central jaeger server (like deployed with jaeger operator itself) that constantly ingest traces, I can go look at those instances and see the execution waterfall and pin point where time is spent.

Hi @bclermont,
Thank you for your reply. I think it would be more clear with the following info added in the first comment. WDYT? Could you please edit it and provided the additional information? PS. I think the versions and vendor used could be helpful as well.
**Is your feature request related to a problem? Please describe.**

I have this operator that is super slow and run in few k8s clusters. I added a ton of logs but sometimes things get sluggish and just by looking at the logs it's very difficult to understand.

**What did you expect to see?**

To really achieve the Level IV Operator Capability level, there should be tracing.

I'm manually adding Jaeger/Opentracing to my operators, but I think it should be implemented directly in operator-sdk and add to the APIs that create children span automatically and let developers implement the sub tracing.

By using a central jaeger server (like deployed with jaeger operator itself) that constantly ingest traces, I can go look at those instances and see the execution waterfall and pin point where time is spent.

// TODO: Add an example of its usage as its result to illustrate what do you expect.

**Environment**
* operator-sdk version:

<!--- Insert operator-sdk release or Git SHA here. -->

* go version:

<!--- Insert the output of `go version` here -->

* Kubernetes version information:

<!--- Insert the output of `kubectl version` here -->

* Kubernetes cluster kind:

* Are you writing your operator in ansible, helm, or go?

**Additional context**
Add any other context about the problem here.


Keep the requets options last

Addresses https://github.com/jillesvangurp/es-kotlin-wrapper-client/pull/24#discussion_r415592902

Thanks for this. I just cut a fresh release with your changes.


Open jbox tooltip near(at the bottom) of the cursor.

I want to show the result of what user is writing now in a tooltip.
when the result is shown in the tooltip, the user can choose the shown result in the tooltip.
How could I show tooltip where the cursor is ?
How could I attach the tooltip to the cursor ?
I'm using that script to show tooltip:
var  tag_system_result =  new jBox('Tooltip', {
                attach: '.show_tag_system_result',
                width: 300,
                theme: 'TooltipBorderThick',
                adjustTracker: true,
                adjustPosition: true,
               // trigger: 'click',
                pointer: false,
                closeOnClick: 'body',
                closeOnEsc: true,
                position: {
                  x: 'center',
                  y: 'top'
                },
                offset: {
                  y: -10
                },
                autoClose: 10000,
                animation: 'zoomIn',
                content: $('#tag_system_result_container')
        });

I can't use  new jBox('Mouse', {}) because with that user can't click on tooltip.

I'm not sure how you could show the tooltip at the cursor position. There probably is a way but it will be tricky.
Maybe you could do something like that: https://jsfiddle.net/StephanWagner/apur420f/

to be more clear:
I'm using that
I'm making facebook similar tag(mention).
If user tape a name, I get that name from database by ajax and show the ajax result in the popover.
The problem is if that div containt many text and user come at the top that div to tape a user name, the popover will be at the bottom of that div while the taped name and cursor are at the bottom.
The popover does not follow cursor.
I want the popover to follow cursor.

I don't think there is a proper solution to get the coordinates of the cursor in a contendeditable div or an textfield/textarea. I just tried google, but most results are to get the cursors position in terms of characters. And even that seems tricky.
If you do find a way to get the x/y coordinates of a cursor and still need help, feel free to reopen this issue.

But some tag mention plug-in show popover near the position of cursor:
Some plug-in like:
https://github.com/luatnd/jquery-mentiony
and:
https://www.jqueryscript.net/demo/Twitter-Like-Mentions-Auto-Suggesting-Plugin-with-jQuery-Bootstrap-Suggest/
I can't use them for many reasons.
They maybe can give you some ideas.
Thanks and i like you plug-in, It helps me too much.

If you do find a way to get the x/y coordinates of a cursor and still need help, feel free to reopen this issue.

https://www.w3schools.com/jsref/tryit.asp?filename=tryjsref_event_mouse_screenxy_clientxy

Ok, so thats what I came up with: https://jsfiddle.net/StephanWagner/apur420f/22/


Don't inherit the unavailability of extensions for imported decls [5.1]

Description: The ClangImporter associates Objective-C protocol members to the first category where the protocol is directly or indirectly adopted, no matter its availability and the availability of other categories. In some cases, this results in imported decls being marked unavailable by the wrong Objective-C category. This fix simply ignores the extension unavailability for imported decls.
Scope of the issue: This affects the XCTest framework where it wrongfully makes some APIs unavailable.
Risk: Low, the fix limits a recent change in the Swift compiler and brings back the old behavior on decls imported from Objective-C.
Reviewed-by: @jrose-apple
Radar: rdar://problem/55350717

@swift-ci Please test


Crashes VS Code On Mac

I can't be positive this preview extension is to blame but when using the extension and editing HTML files VS Code will crash many times throughout the day. If the preview pane is not open VS Code does not crash.  The extension works for periods of time (10-15 minute editing sessions for example) before crashing. I haven't identified anything specific but sometimes a simple edit in the HTML brings up the beach ball, VS Code becomes unresponsive and the crash reporter dialog from Apple appears.
Running macOS 10.14.6 and
VS Code 1.37.1

Same issue here on 1.42.1 VS Code with macOS 10.15.1


Collect HTTPD

https://httpd.apache.org/security_report.html

Closed via https://github.com/nexB/vulnerablecode/pull/261


test: run more tests

just curious to see what breaks

black and mypy are failing, but that is another PR (#8)

some issues, from witty...
C:\hostedtoolcache\windows\Python\3.11.9\x64\Lib\site-packages\witty\compile_module.py:2: in <module>
    import fcntl
E   ModuleNotFoundError: No module named 'fcntl'

fcntl is not available on windows.  The substitute is win32api calls... but that's not a drop-in replacement. so that will take some doing.

the witty issues were patched in  https://github.com/funkelab/witty/pull/2

looks like this package can't support python 3.13 yet because cheetah3 uses cgi which is removed in python 3.13.  See s

ok everything is now almost working across all platforms and python versions.  The last holdout is windows, and it's because I can't yet figure out how to get the <stdatomic.h> include working on windows.  If simply define RTREE_NOATOMICS when compiling, then everything also works on windows (which is great!).  I think we should just do that for now... but that requires a change in witty... which is what prompted https://github.com/funkelab/witty/pull/3

All working now, but with the caveat on windows that we use no atomics


Delete all non-existing schedules on deploy

Currently, when the action is run on a "push" the following will be done to handle schedule deployments:
For each schedule mentioned in the config file:

Delete any existing schedules with the name of the current schedule
Recreate the schedule

This is however flawed, as this will not delete a schedule that's no longer exists in the config file. A new and better flow would be:

Before deploying any schedules, delete all existing schedules
For each schedule mentioned in the config file: Deploy

To make these updates one would have to update index.py and schedules.py.

should be resolved with v2 tag action


contextlib.py ResourceWarning: unclosed <ssl.SSLSocket...

I get some warnings about unclosed SSL socket, looks like:
...
.../utilities/test_utils.py:110: in __exit__
	self.vcr_mock.__exit__(exc_type, exc_val, exc_tb)
site-packages/vcr/cassette.py:105: in __exit__
	next(self.__finish, None)
site-packages/vcr/cassette.py:65: in _patch_generator
	with contextlib.ExitStack() as exit_stack:
/usr/local/lib/python3.10/contextlib.py:561: in __exit__
	if cb(*exc_details):
site-packages/vcr/patch.py:402: in __exit__
	connection = pool.pool.get()
/usr/local/lib/python3.10/warnings.py:109: in _showwarnmsg
	sw(msg.message, msg.category, msg.filename, msg.lineno,
.../settings/warning_handler.py:47: in __call__
	frames = traceback.extract_stack()
WARNING from "test_sdk_client.py" in test_get_category_by_key():
"/usr/local/lib/python3.10/contextlib.py ResourceWarning: unclosed <ssl.SSLSocket fd=4, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=...>"

Any advise to fix that?

Hi @jedie there are many details missing from your report. Python version seems to be 3.10, version of vcrpy is unclear, user level code doing the requests is unclear, could be requests, urllib3 v1 or v2 etc, is this behavior new or does it happen across all versions of vcrpy etc. Please add more details.

Thanks! Is this behavior new or does it happen across all versions of vcrpy?
File test_sdk_client.py was making requests using requests directly or with some layer in between? If so which one?
I think vcrpy does not open SSL connections by itself so I would assume it's either a bug in vcrpy's connection pool code or the library outside of vcrpy that does open SSL connections. I'm guessing here, any help with debugging is welcome.

Three weeks without a reproducer, closing as "cannot reproduce". Happy to re-open if someone can provide a minimal producible example. Thanks!

Sorry, i have currently no time to investigate this further... I currently just ignore the warning ;)

Hi @hartwork,
This repo created by @mezhaka has a minimal reproducible example with pytest and here is an even simpler one without pytest:
import warnings
import requests
import vcr

def main():
    session = requests.Session()
    with vcr.use_cassette(path="/dev/null"):
        session.get("http://neverssl.com")
        # session.close()

if __name__ == "__main__":
    warnings.filterwarnings("always", category=ResourceWarning)
    main()

In Python 3.8, with vcrpy 5.1.0 I get a sys:1: ResourceWarning: unclosed <socket.socket fd=6, family=2, type=1, proto=6, laddr=('<IP_ADDRESS>', 64833), raddr=('<IP_ADDRESS>', 80)>. Even closing the session explicitly with session.close() will not stop the ResourceWarning.

here is an even simpler one without pytest:

I've been trying to make this one fail locally to try and fix this (and also provide a new unit test for vcrpy) but can't seem to do so. Is there anything else that needs installing? It just seems to work with no failure for me.

I haven't seen this error for a while. So i assume it's fixed. But i have no more details, sorry.

I'm able to reproduce this reliably with current vcrpy master. Adding the connection.close() line from https://github.com/kevin1024/vcrpy/pull/758 resolves the issue.
Now trying to isolate a test case that isn't my entire closed-source app...

Reproduction steps

Checkout current vcrpy master
pip install pytest-vcr
Dump the following into "test.py"

import warnings
import pytest
import requests

@pytest.mark.vcr
def test_main():
    warnings.filterwarnings("error", category=ResourceWarning)
    session = requests.Session()
    session.get("http://neverssl.com")

m -Rf cassettes && pytest test.py -vvv -s

That last step reliably gets the following
platform linux -- Python 3.8.14, pytest-7.4.0, pluggy-1.2.0 -- /home/palfrey/.virtualenvs/vcrpy/bin/python
cachedir: .pytest_cache
rootdir: /home/palfrey/src/vcrpy
configfile: pyproject.toml
plugins: vcr-1.0.2, cov-4.1.0, httpbin-2.0.0
collected 1 item

test.py::test_main PASSED

================================================================ warnings summary =================================================================
test.py::test_main
  /home/palfrey/.virtualenvs/vcrpy/lib/python3.8/site-packages/_pytest/unraisableexception.py:78: PytestUnraisableExceptionWarning: Exception ignored in: <socket.socket fd=-1, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6>

  Traceback (most recent call last):
    File "/home/palfrey/.pyenv/versions/3.8.14/lib/python3.8/contextlib.py", line 510, in __exit__
      if cb(*exc_details):
  ResourceWarning: unclosed <socket.socket fd=5, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('<IP_ADDRESS>', 52936), raddr=('<IP_ADDRESS>', 80)>

    warnings.warn(pytest.PytestUnraisableExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

The pytest-vcr could be the issue, but given the connection.close() patch seems to fix this, I doubt it!

here is an even simpler one without pytest:

I've been trying to make this one fail locally to try and fix this (and also provide a new unit test for vcrpy) but can't seem to do so. Is there anything else that needs installing? It just seems to work with no failure for me.

Here are the steps to reproduce the problem in a container to make sure you have exactly the same environment:
$ docker run --rm -it python:3.11 bash

root@container:/# pip install vcrpy==5.1.0 requests==2.31.0
root@container:/# cat > test.py
# copy/paste the code from my previous comment (https://github.com/kevin1024/vcrpy/issues/710#issuecomment-1667240075) and press ctrl-d

root@container:/# python test.py
sys:1: ResourceWarning: unclosed <socket.socket fd=3, family=2, type=1, proto=6, laddr=('<IP_ADDRESS>', 50746), raddr=('<IP_ADDRESS>', 80)>
ResourceWarning: Enable tracemalloc to get the object allocation traceback

resolved in https://github.com/kevin1024/vcrpy/pull/811


Display of time elapsed?

Is there anyway to display the number of seconds the recording has been running (like in a standard camera)?

Hi @crexes currently there is no support for that, but you are free to build it yourself. :)

I can't find any callback which provides the running recording time.

can't find any callback for showing running recording time.

@amitclickapps: small FYI, the recordingtime has been added


Remove custom floor helper

This project uses semver, please check the scope of this pr:

[ ] #none# - documentation fixes and/or test additions
[x] #patch# - backwards-compatible bug fix
[ ] #minor# - adding functionality in a backwards-compatible manner
[ ] #major# - incompatible API change

Notes
This project has ember-math-helpers as a dependency so a custom floor helper is no longer needed. As far as I can tell, it's only used in one place anyway, which is in the pagination template for the last page button. I tested the pagination buttons after removing these files and it still works.
Resolves #84
CHANGELOG

Remove custom floor helper

Changes Unknown when pulling 2b6685137e3fade6b877ef7b77fecd0d07fd9717 on jscharf:remove-floor-helper into ** on ciena-frost:master**.

References to floor need to be removed from tests/unit/helpers/is-lead-selection.js

This PR needs to be a major, not a patch.  This is due to the fact that we were exporting this floor helper at the ember-frost-list/helpers/floor namespace and do not know what other consuming code may still be doing so, regardless of whether we have quit consuming it internally in this add-on.


Fixes Ignoring Value of -Verbose/-Debug

Type of Change

[x] Bug fix (non-breaking change, fixes # )
[ ] New feature (non-breaking change, adds functionality, fixes # )
[ ] Breaking change (effects multiple commands or functionality, fixes # )
[x] Ran manual Pester test and has passed (.\tests\manual.pester.ps1) (please note that this change returns WARNING: No tests to be run)
[ ] Adding code coverage to existing functionality
[ ] Pester test is included
[ ] If new file reference added for test, has is been added to github.com/sqlcollaborative/appveyor-lab ?
[ ] Unit test is included
[ ] Documentation
[ ] Build system

Purpose
This PR tries to fix the issues in #7318
Approach
This contains two relevant changes:

Adds a check to Verbose output and Warning output logic, to ensure that not only was the -Verbose/-Debug parameter passed but it is true
Only re-sets DebugPreference=Inquire if it was previously set, or if we're in a breakpoint (as I am less sure that this wasn't intended)

Commands to test
To test this, I used the examples provided for reproduction in the bug:
$DebugPreference = 'Continue'
$VerbosePreference = 'Continue'
$InformationPreference = 'Continue'
$ProgressPreference = 'Continue'
$WarningPreference = 'Stop'
Write-Debug 'My script debug'
Write-Verbose 'My script verbose'
Write-Information 'My script information'
Get-DbaRegServer -SqlInstance 'SQLDBAPROD' -Group 'DISABLED', 'IGNORE' -EnableException -Debug:$false -Verbose:$false -InformationAction:SilentlyContinue -WarningAction:SilentlyContinue

I'll admit a complete lack of server here, but don't think it hurts my testing - and benefits the testing of the Inquire.
Screenshots
Before:

After:

I feel I'm sorely lacking tests in code for this - should I try and find a test to create/update?

🤯  oh wow! thank you so very much! looking forward to testing this 😊

oh you asked a question -- i'll test by compiling and running. not sure how else to test

Looks great! I ran Get-DbatoolsLog | OGV and that looked right, too. Thanks so much for this 🙇🏼


Wave browser devtools

It might be a good idea to have Wave browser devtools (similar to React), that would allow you to see all your cards with their state in a neat and searchable manner.

The implementation should be relatively simple - just intercept the ws connection and show it onscreen. As small additional feature, we could add filtering so that users don't have to search through whole card tree.
cc @lo5 @geomodular for discussion.

+1 - would be useful for debugging.
Are you referring to a Chrome devtools extension?
I typically go to Network -> WS to observe traffic and drill through objects, but it's not all that usable, especially when you want to observe changes to specific cards or components. If we're providing a UI for this (either in-browser or via devtools), it should at least have a UX for observing specific cards - and I don't know what that would look like. Any ideas?
A UI-less way to do this could be a meta flag that dumps traffic into the console, but in a smart way (e.g. only changes/diffs).

+1 - would be useful for debugging.
Are you referring to a Chrome devtools extension?
I typically go to Network -> WS to observe traffic and drill through objects, but it's not all that usable, especially when you want to observe changes to specific cards or components. If we're providing a UI for this (either in-browser or via devtools), it should at least have a UX for observing specific cards - and I don't know what that would look like. Any ideas?
A UI-less way to do this could be a meta flag that dumps traffic into the console, but in a smart way (e.g. only changes/diffs).

Are you referring to a Chrome devtools extension?

Chrome extension in general.

it should at least have a UX for observing specific cards - and I don't know what that would look like. Any ideas?

I imagine something like this
https://user-images.githubusercontent.com/64769322/105014523-d6052400-5a40-11eb-8ef3-16a7c627bd05.mov
However, our cards or not really hierarchical, but rather flat so instead of displaying a tree, we would have just a simple list that could be searched through and inspected. Basically what can be seen in the video above.

A UI-less way to do this could be a meta flag that dumps traffic into the console, but in a smart way (e.g. only changes/diffs).

This is also an option, but printing every change will quickly pollute the whole console. To mitigate it, we would have to use console.clear which will have unwanted side effect - it will remove also any browser errors if present which makes debugging harder actually. In addition to that, logging only changes does not easily provide big picture as opposed to UI.
I personally think having a UI is better option in terms of usability and readability.

Are you referring to a Chrome devtools extension?

Chrome extension in general.

it should at least have a UX for observing specific cards - and I don't know what that would look like. Any ideas?

I imagine something like this
https://user-images.githubusercontent.com/64769322/105014523-d6052400-5a40-11eb-8ef3-16a7c627bd05.mov
However, our cards or not really hierarchical, but rather flat so instead of displaying a tree, we would have just a simple list that could be searched through and inspected. Basically what can be seen in the video above.

A UI-less way to do this could be a meta flag that dumps traffic into the console, but in a smart way (e.g. only changes/diffs).

This is also an option, but printing every change will quickly pollute the whole console. To mitigate it, we would have to use console.clear which will have unwanted side effect - it will remove also any browser errors if present which makes debugging harder actually. In addition to that, logging only changes does not easily provide big picture as opposed to UI.
I personally think having a UI is better option in terms of usability and readability.


Use integers for units division

Numbers in time units divisions are generally integers (24/60/60), so they can be defined that way and Python3 will convert the division to a float automatically.

[x] Tests with a significant number of years to be tested for your calendar.
[x] Changelog amended with a mention describing your changes. Note Please do NOT change the version number here. It's the project maintainers' duty.

ah. TIL

ah. TIL


example "wapm fortune" outputs nothing

both wapm fortune and wax fortune output nothing. (cowsay works fine with both)

Ah thanks! That is the risk I guess with wapm as it pulls these files directly from their repository. I see it's 404 now. I will try and add an error in Terminal to make that clear.

Now 404's show as command not found.


rcm: merge the two PushCompose functions

See individual commits. Lots of cleanup-type commits leading up to be able to merge these two functions.
@msehnout I wonder about the benefit of the common types. There's lots of code to convert between them and strings, all of which can return an error.

I've manually verified that the rcm integration tests still pass on Fedora (after applying the patch in https://github.com/osbuild/osbuild-composer/pull/333):
$ make rpm
$ sudo dnf install rpmbuild/x86_64/RPMS/*.rpm
$ sudo systemctl start osbuild-rcm.socket
$ sudo /usr/libexec/tests/osbuild-composer/osbuild-rcm-tests
2020/03/17 06:52:21 Success: the v1/compose returned compose UUID: ace94271-418d-4661-818b-74c073759930
2020/03/17 06:52:21 Success: the v1/compose/ace94271-418d-4661-818b-74c073759930 returned status: RUNNING
[vm-user@vm osbuild-composer]$ echo $?
0

@msehnout I wonder about the benefit of the common types. There's lots of code to convert between them and strings, all of which can return an error.

We discussed this when I was working on the prevous refactoring. Most of them will go away once we use ONLY the common types and never strings, because we shouldn't hardcode the same string all around the place.
The other thing is that golang does not provide an enumeration type which leaves us only with type aliases and named constants. This inherently leaves space for errors but it is a language design choice, so there is nothing I can do about it.

We discussed this when I was working on the prevous refactoring. Most of them will go away once we use ONLY the common types and never strings, because we shouldn't hardcode the same string all around the place.
The other thing is that golang does not provide an enumeration type which leaves us only with type aliases and named constants. This inherently leaves space for errors but it is a language design choice, so there is nothing I can do about it.

I think this is a bigger discussion which we should have separately. I shouldn't have started it on this PR. I'll file an issue.

I think this is a bigger discussion which we should have separately. I shouldn't have started it on this PR. I'll file an issue.

We had a discussion on this here: https://github.com/osbuild/osbuild-composer/issues/193 and follow up discussions over BlueJeans.

After discussing the context with Tom, this change makes more sense. I'm happy to merge it now. Thanks!

Thanks a lot :blush:  I've created https://github.com/osbuild/osbuild-composer/issues/342 last night—I'll try doing that earlier next time around.


How to reset trained adapter model?

Hi all,
I am trying to train a model with an adapter in a loop.
In each iteration, I want the model to be initialized and train the adapter from scratch (only the adapter, no full finetuning).
My question is: If I initialize the model as shown in the snippet below, is the model initialized with random weights or does the training in each iteration start with weights from the previous iteration?
Here is the snippet for my question:
    model =  AutoModelWithHeads.from_pretrained(
        model_name,
        config=config,
    )
    try:
        # Add a new adapter --> This raises a ValueError if the adapter was already added in a previous iteration
        model.add_adapter("test")
        # Add a matching classification head
        model.add_classification_head(
            "test",
            num_labels=2,
            id2label={ 0: "no_test", 1: "test"}
        )

    except ValueError:
        # Activate the adapter if it was already there.
        model.set_active_adapter("test")

    model.train_adapter("test")

    training_args = TrainingArguments(...)
    trainer = Trainer(...)
    trainer.train()

Hi @DavidPfl,

If I initialize the model as shown in the snippet below, is the model initialized with random weights or does the training in each iteration start with weights from the previous iteration?

Currently, your snippet reuses the weights from the previous iteration as an existing adapter cannot be overwritten (hence the ValueError). We can consider adding an option to overwrite existing adapters.

Hi @calpt,
since my initial question, I adjusted the code to use the model_init argument in the Trainer initialization. I did so because I read here that this ensures reproducibility when fixing the random seed.
The loop would then look like this:
def get_model():
  model =  AutoModelWithHeads.from_pretrained(model_name, config=config)
  try:
      # Add a new adapter
      model.add_adapter("hyperpartisan")
  except ValueError:
      # ValueError  is raised when adapter already exists.
      pass
  try:
      model.add_classification_head(
          "hyperpartisan",
          num_labels=2,
          id2label={ 0: "neutral", 1: "hyperpartisan"}
      )
  except ValueError:
      # ValueError  is raised when adapter already exists.
      pass
  finally:
      model.set_active_adapters("hyperpartisan")
      model.train_adapter("hyperpartisan")
  return model

for _ in range(2):
  # here I change some hyperparameters for grid search
  training_args = TrainingArguments(...)
  trainer = Trainer(model_init = get_model, ...)
  trainer.train()

Would this initialize the adapter with the same random weights in each iteration or would I continue with the same weights as from last iteration?
If the weights are still not reinitialized, how can I overwrite the existing adapter or make sure that in each loop iteration I start the adapter weights from scratch?
Maybe I am trying to fix an unneccesary problem. My intention is to do a grid search over some hyperparameters in a for-loop.
Is there a better way for doing this?

Hi @DavidPfl,

Would this initialize the adapter with the same random weights in each iteration or would I continue with the same weights as from last iteration?

It would reuse the weights.
We figured that there currently is no straightforward to do what you are describing. So, based on your use case, we're adding a delete_adapter() method in the next version. There will also be a new parameter overwrite_ok for add_adapter() to overwrite the weights each time add_adapter() is called. See https://github.com/Adapter-Hub/adapter-transformers/pull/189.
Hope this helps!

So, based on your use case, we're adding a delete_adapter() method in the next version. There will also be a new parameter overwrite_ok for add_adapter() to overwrite the weights each time add_adapter() is called.

This was released with v2.1.0.


folder --> partition :: instance_name --> name

This is simply a rename.

Alas, sample code in documentation and README still use old names.


Exposing FirebaseArray

Making it accessible from the lib.

Thanks for the PR.
When we designed the public API for FirebaseUI, we decided against exposing
FirebaseArray publicly. The expectation was that many people would start
treating this as a normal array/collection on Firebase and be surprised by
the realtime updates to it.
So we are intentionally not exposing the FirebaseArray. You're free to
take the FirebaseArray from this project and use it as they see fit of
course, but it'll stay out of the public API for the moment. Let us know
what you use it for though, we'd love to learn more about that so that we
can potentially re-evaluate our decision in the future.
On Tue, Mar 1, 2016 at 10:27 PM googlebot<EMAIL_ADDRESS>wrote:

Thanks for your pull request. It looks like this may be your first
contribution to a Google open source project. Before we can look at your
pull request, you'll need to sign a Contributor License Agreement (CLA).
[image: :memo:] Please visit https://cla.developers.google.com/
https://cla.developers.google.com/ to sign.
Once you've signed, please reply here (e.g. I signed it!) and we'll
verify. Thanks.

If you've already signed a CLA, it's possible we don't have your
GitHub username or you're using a different email address. Check your
existing CLA data https://cla.developers.google.com/clas and verify
that your email is set on your git commits
https://help.github.com/articles/setting-your-email-in-git/.
If you signed the CLA as a corporation, please let us know the
company's name.

—
Reply to this email directly or view it on GitHub
https://github.com/firebase/FirebaseUI-Android/pull/89#issuecomment-190912481
.

Thanks for replying,.
I understand your worries.
IMO, it could be tempting to use it as a normal array/collection if you had a FirebaseArray. As it is, we still have to parse DataSnapshot to our Class and there's not a setItem call.
I'm using it because of the logic with the indexes. It's much easier to handle FirebaseArray .OnChangedListener than ChildEventListener. For me it's a convenient way to mirror and feed my own array.
I know I'm duplicating data. By making FirebaseArray public I'm trying to not duplicate code in the project as well.
Thanks anyway

@puf Does the reasoning behind this decision still apply in light of the fact that FirebaseUI-iOS exposes FUIArray? It's an incredibly useful helper class. In particular, right now it's a lot of manual work to write a FragmentPagerAdapter to Firebase that the FirebaseArray would do.


New screen option: ShowStatusBar

I added new option in the screen, which allowes App Inventor users to enable/disable ShowStatusBar. This method is in the form of the getter method in the block editor and as property in the designer property list. But there won't be any change in the designer viewer if you decide to change them. Future work, make the changes reflect on the designer viewer.
I am implement the method in the following way - use getWindow().clearFlags(WindowManager.LayoutParams.FLAG_FULLSCREEN). We can also change it in the manifest,  but this hide all the status bar.
I want to give the maximum design freedom to App Inventor users, so I have proposed the following method. All the API calls exist since API level 1.
The old commit is here -
https://github.com/mit-cml/appinventor-sources/pull/185

@halatmit @jisqyv @afmckinney

I tried this, and it does not seem to work for me, testing on Lollipop.  If I have an app with ShowStatusBar checked, I don't see a status bar.  However, I can swipe down over the title bar and the status bar is shows temporarily.   This behavior is the same whether or not showSatusBar is checked.
On the emulator, the status bar is shown, but the thing controlled by ShowStatusBar appears to be the Title, not the status bar.
can you give me a demo of how this is supposed to work?   Also, as I think about it, is there a reason to have separate controls for title and status?  Why not have a single FullScreen property that controls them both?

@halatmit I verified this and this approach doesn't work on Lollipop. I will try to finish this pull request next week.

I double checked again. The previous solution (for status bar, this pull request) works on Android 5.0,
lollipop as well. Can you try the attach apk and provide comment?
https://www.dropbox.com/s/fvkwfycz0rdrbr5/AndroidStatusBar.apk?dl=0
Wei
<EMAIL_ADDRESS>

I double checked again. The previous solution (for status bar, this pull request) works on Android 5.0,
lollipop as well. Can you try the attach apk and provide comment?
https://www.dropbox.com/s/fvkwfycz0rdrbr5/AndroidStatusBar.apk?dl=0
Wei
<EMAIL_ADDRESS>

The apk you provided seems to work.  But when i pull down this commit and build it, I have problems.
(1) If I start a new project then showStatusBar is checked in the designer, but the phone doesn't show a status bar, and if I go to the blocksk editor and evaluate the showStatusBar property it returns false.
(2) Also, there is no setter for the showstatusBar property in the blocks.   Is that indended?

I think I know where the confusion is from.
(1) Are you using the MIT AI companion to develop? There is no problem for the installed the apk, but I see the same issue you provided on the MIT AI companion.
(2) Yes, back then, you told me we should not add more methods to the setter methods draw until we figure out a better way to show them?

OK.  Fix the companion issue so this works in live deevelopment.
I wasn't clear when  made that comment.  I didn't mean the setter in
particular, but rather that we should not add more property blocks (setters
or getters) and just put them in the
dropdowns.  But maybe I'm wrong and we should also have the blocks (and
also have them in the dropdowns).
Let me know when I can do another review.
== Hal Abelson
<EMAIL_ADDRESS>Prof. of Comp. Sci. and Eng.
MIT Dept. of Elec. Eng. and Comp. Sci.
MIT Media Lab, Second Class Faculty
On Sat, Feb 21, 2015 at 3:33 PM, WeiHua Li<EMAIL_ADDRESS>wrote:

I think I know where the confusion is from.
(1) Are you using the MIT AI companion to develop? There is no problem for
the installed the apk, but I see the same issue you provided on the MIT AI
companion.
(2) Yes, back then, you told me we should not add more methods to the
setter methods draw until we figure out a better way to show them?
—
Reply to this email directly or view it on GitHub
https://github.com/mit-cml/appinventor-sources/pull/223#issuecomment-75391404
.

@halatmit  try the new code again?
If you prefer, use the following aia and apk for testing:
https://www.dropbox.com/sh/4hl50hbd32kln77/AACXRkBnuN3zRFm9dLX0O6wia?dl=0
Thanks,
Wei

@halatmit regenerated the documentation.

You also have to update versioning.js. Search for "Screen" (near line 1701). What you need to change should be obvious.
-Jeff

@halatmit @jisqyv This is updated and should be ready to review and merge.

works fine, also works fine on Froyo
please add the translations for the new property

@halatmit @jisqyv added the translations.

LGTM

@weihuali0509 MERGED onto the ucr branch for the next component release


Switch to HAML views

Connected to #49

Coverage decreased (-0.2%) to 86.128% when pulling d662236ad7b220b630a81b9ae18039b6ad0d0454 on convert-erb-to-haml into df1baad6b6426fc55f65cb3ab95270565fdd5d6a on master.

Coverage increased (+0.6%) to 86.831% when pulling adb3182cd9b0f29393bec5f9ca8d4095a206c1fa on convert-erb-to-haml into df1baad6b6426fc55f65cb3ab95270565fdd5d6a on master.


Update README

Fix typo should reference v5 instead of v4

good catch, thanks!

FYI, #204 fixes this

Fixed in #208


Error? Bug?

Extension Version: 0.2.2
VS Code Version: 1.7.1
OS Version: Win10 redstone 1
Node.js Version (result of command node -v): 6.9.1
NPM Version (result of command npm -v): 3.8+

Steps to Reproduce:

install extendsion
alt+c p or global command 'color picker' , can show GUI.....everytime show this status;

Log (All lines):
(Click menu of VS Code "Help > Toggle Developer Tools", and click "Console" tab)
Host] Error: Cannot find module 'npm'
    at Function.Module._resolveFilename (module.js:455:15)
    at Function.Module._load (module.js:403:25)
    at Function.M.d._load (d:\Microsoft VS Code\resources\app\out\vs\workbench\node\extensionHostProcess.js:12:28523)
    at Module.require (module.js:483:17)
    at require (internal/module.js:20:19)
    at getNpm (C:\Users\crper\.vscode\extensions\anseki.vscode-color-0.2.2\node_modules\process-bridge\process-bridge.js:139:15)
    at initModule (C:\Users\crper\.vscode\extensions\anseki.vscode-color-0.2.2\node_modules\process-bridge\process-bridge.js:220:10)
    at getHostCmd (C:\Users\crper\.vscode\extensions\anseki.vscode-color-0.2.2\node_modules\process-bridge\process-bridge.js:331:9)
    at C:\Users\crper\.vscode\extensions\anseki.vscode-color-0.2.2\node_modules\process-bridge\process-bridge.js:394:19
    at Object.exports.sendRequest (C:\Users\crper\.vscode\extensions\anseki.vscode-color-0.2.2\node_modules\process-bridge\process-bridge.js:468:34)
    at pickConvert (C:\Users\crper\.vscode\extensions\anseki.vscode-color-0.2.2\lib\color-helper.js:180:15)
    at exports.pick (C:\Users\crper\.vscode\extensions\anseki.vscode-color-0.2.2\lib\color-helper.js:220:24)
    at t.$executeContributedCommand (d:\Microsoft VS Code\resources\app\out\vs\workbench\node\extensionHostProcess.js:10:25694)
    at t.e.handle (d:\Microsoft VS Code\resources\app\out\vs\workbench\node\extensionHostProcess.js:10:10602)
    at s (d:\Microsoft VS Code\resources\app\out\vs\workbench\node\extensionHostProcess.js:7:21356)
    at p (d:\Microsoft VS Code\resources\app\out\vs\workbench\node\extensionHostProcess.js:7:22033)

I shold install node and npm on global environment!!!

Hi @crper,
It seems that this is a duplicate of #14.
Please read that issue, and comment to that if you need.
And also, that seems a part of log.
Your NPM does not seem to be available in the VS Code process.


Release 0.24.1

This release is mainly to test out the new debian packaging that allows for installing old versions of ponyc via apt-get.

Waiting for CI on master to run. Planning on blessing ceeb955e5a1845fa4541c00b088b2867c629a182.

CI passed. Blessing ceeb955.

release started

homebrew pr opened: https://github.com/Homebrew/homebrew-core/pull/30350

@stefantalpalaru @kamilchm release underway

releases notes pr: https://github.com/ponylang/ponylang.github.io/pull/315

So.. it seems I've broken the release process for linux somehow with the combination of the debian packaging changes and the non-x86 CI changes. Details can be found here for anyone curious: https://travis-ci.org/ponylang/ponyc/builds/406727331.
I'm going to be looking into what is going on. Hopefully it's a minor/easy fix.

Homebrew released, windows and debian packages available via bintray, playground updated, docker images done.

COPR/PPA are both broken and will require another release to fix because they both download the tar.gz file from github for the specific tag being built (so my fixes to resolve the issues aren't included).
On the bright side, I've resolved all the issues with the build/release process.

I have to wake up at 6:30 am (and it's almost 2 am now) for a long/busy day tomorrow.
Given that COPR/PPA are broken, finishing this release and announcing it right now doesn't make sense. I'll finish this release (and do the next one) tomorrow night hopefully.

I'll wait for the next release, then.


Ray storage dir cannot be created

Hi,
on our cluster the current method to generate the path for the ray directory is not working. It seems that os.getlogin() does not result in a  meaningful value.
storage_dir = "file:///tmp/ray/" + os.getlogin() + "/workflow_data"
I get back an OS error that the device does not exist.
After removing os.getlogin() the workflow initiates properly.
Would it be possible to define the ray-storage dir via a flag like the ouput dir?
Thank you and all the best,
Dominik

Good suggestion. We can use timestamp to create the dir.


Evaluating lvalues and values independently in copy-in copy-out

It looks like the current implementation evaluates things twice, once to get the value for in and once to get the lvalue for out. Here's a condensed example... the apply block of C should increment hdr.h[1], but instead it increments hdr.h[2].
header h_t {
    bit<32> v;
}
struct metadata { }
struct headers {
    h_t[10] h;
}
bit<32> incrAndReturn(inout bit<32> x) {
    x = x + 1;
    return x;
}
void incrHdr(inout h_t x) {
    x.v = x.v + 1;
}
control C(headers hdr) {
    apply {
        bit<32> x = 0;
        incrHdr(hdr.h[incrAndReturn(x)]);
    }
}

hmm I noticed this but thought it wouldn't affect correctness. Will investigate further.


Deeplabv3() got an unexpected keyword argument

Using TensorFlow backend.
Traceback (most recent call last):
File "C:/Users/pdrt/Desktop/keras-deeplab-v3-plus/load_weights.py", line 16, in
model = Deeplabv3(input_shape=(512, 512, 3),num_classes = 21)
TypeError: Deeplabv3() got an unexpected keyword argument 'num_classes'
Instantiating an empty Deeplabv3+ model...
Why? How can I fix thiss?

I forgot to fix the README. use "classes" argument instead

many thanks


How to lazy load this extension with packer.nvim

I tried the following, but it didn't work as expected
  {
    "nvim-telescope/telescope-symbols.nvim",
    -- event = "BufRead",
    cmd = "Telescope",
  },

If I use event trigger, it works.
But I an looking forward to use cmd or keys trigger like above.

Actually you dont. This repo doesnt even have lua/vim files that will be loaded. Its a repo to store json data and a lua/julia script to pull the latest data in a json file. The json files will be loaded on running :Telescope symbols.
You can also just download the json files (sources) you want and put them in any path that you wanna have. After that you just have to call Telescope symbols with that path. See :help builtin.symbols()

Thanks for your reply~


Feature request : add link “report new station” to main menu

Could be useful to create a new menu item for following link :
https://www.goingelectric.de/stromtankstellen/new/

Will be added in the next update ✔

Thanks 😊
Is the GE API capable of adding stations to ?

Is the GE API capable of adding stations to ?

No, unfortunately not.

Is this in version 0.3.4 ?

Yes!

I know there is no way to add a station via the API. But maybe that's too complicated for the casual user anyways.
The chargeprice app has solved this problem with a simple form (Where?, Who?, Addiditional Infos) which everyone can fill out. And someone on the backend adds the station. I mean I would't outsource this to developers on the backend. But maybe there could be something like "Discovered Charging Stations".
The only problem I see here is the need of a necessary database. Maybe the app can send out a command which posts the infos in the GoingElectric EVMap Thread? Would that be even possible?

In contrast to Chargeprice, who are a commercial company, I don't have the resources to process such user requests to add a charging station (and of course it is also difficult to verify them). And creating a separate database of "Discovered charging stations" would again increase the fragmentation of EV charging data sources (because it would be an additional data source only available through EVMap...).

Maybe the app can send out a command which posts the infos in the GoingElectric EVMap Thread? Would that be even possible?

Might be possible, but I guess a bot posting on the forum would also be frowned upon by the GoingElectric website owner...


I can't type changes in my file

When I enabled the plugin in the latest version of WebStorm, it worked as expected.
Then I restarted it and the file stayed in the loading spinner forever.

I disabled the plugin, the file loads. I enable it, highlighting works but I can't type (for some reason I can delete to the right but not to the left) 🤷
Details about my installation:
WebStorm 2020.3.2
Build #WS-203.7148.54, built on January 25, 2021
Runtime version: <IP_ADDRESS>+11-b1145.77 x86_64
VM: OpenJDK 64-Bit Server VM by JetBrains s.r.o.
macOS 10.15.7
GC: ParNew, ConcurrentMarkSweep
Memory: 8083M
Cores: 16
Registry: typescript.service.node.arguments=--max_old_space_size=9216
Non-Bundled Plugins: com.vecheslav.darculaDarkerTheme, org.toml.lang, ru.adelf.idea.dotenv, org.asciidoctor.intellij.asciidoc

MDX version installed: 1.1

Could you please share the IDE logs (menu Help - Collect Logs)? Thanks!

Sure thing! Here they are! Thank you!
webstorm-logs-20210202-143442.zip

Thanks!  Any chance you can share your MDX file?

I think I can share this file (I'm getting errors in it as well)
docsSyntax.mdx.zip
Thanks again!

Simplified example:
### Internal links

```html
<DocLink id="docsSyntax" />
<DocLink id="docsSyntax" text="Different link text"/>
<DocLink id="docsSyntax" tooltip />
<DocLink id="docsSyntax" section="unordered-lists" text="Linking to a specific section" />

If you include a section qualifier, you must use the resolved anchor ID
(e.g. "unordered-lists"); do not use the section title (e.g. "unordered lists").


ezBIDS

Meeting with Dan Levitas on April 11th: Discussed incorporating the eyetrack spec in ezBIDS, together with beh and other physio stuff.
Also available on Docker for local use, Singularity not figured out yet:
https://github.com/brainlife/ezbids/pull/109
Would be nice to figure it out that it can be used on institutional clusters (or talk to IT staff)
ToDo:

share behavioral data for testing with Dan

update: talked to Dan, he is waiting for us to finish first version of converter, then he takes care of implementing it in ezBIDS. Docker for installing ezBIDS on a institutional VM is given.


async_wrap: when is callback ready to be called

While developing dprof I came to realize that using beforeTimestamp (pre hook) - initTimestamp (init hook) as an async duration estimate is a bit misleading.
For example if user create a timeout of 100 ms and in the meanwhile have a cpu hungry calculation there takes 200 ms. The async operation only takes 100 ms but the beforeTimestamp - initTimestamp would indicate 200 ms.
A bit more likely, user could do fs.open which would finish quickly, but have so many other callbacks there needs calling first that it would take much longer time before the fs.open callback is called.
In both cases it would look like the async operation took much longer than it actually did. The user would ask questions like "why did my timeout take 200 ms, when I set it to 100 ms?" or "why is my filesystem so slow?".
I don't known if it is possible but I think a asyncReady event is missing. This would emit when the async operation is done. I'm guessing there is some interrupt causing a push the job queue that one could listen on, but I don't know. Emitting the event immediately would be problematic, as the javascript program would jump in a sync state. So I guess asyncReady it will just have to be executed right after the current callback is done. This would fix the fs.open example, but not the setTimeout example.

When the thread is done and when it can get inserted back into the main thread are two different things. If some sync code continues to block past when the async thing is done, there'd be no way for it to enter the suggested "ready" callback.
fs.readFile(file, function (err, data) {
  console.log('data is', data)
})

var now = Date.now()
var then = now + 1000
while (Date.now() < then) {
  // Main thread is still busy in here when readFile is done.
  // Therefore, it can not trigger some async_wrap callback.
}

Yeah, that is the timeout example, that I don't think can be solved.
But if you have:
for (var i = 0; i < 1000; i++) {
  fs.open(file[i], 'r', function (err, fd) {
    var now = Date.now()
    var then = now + 10
    while (Date.now() < then);
  })
}

setTimeout(function () {
  // May first emit after 1000 x 10 ms
}, 20);

then it should be possible to emit a asyncReady event after two fs.open callbacks (20 ms), as the main thread is not in a blocking state. But the actual setTImeout callback may first be called after a while (1000 x 10 ms).

I have been thinking a lot about this specific issue.  A simple alternative
would be to pass along a timestamp when the before hook is called.  It
would probably be relatively easy to capture a timestamp when async tasks
complete.  Injecting new things into the queue of things to run sounds like
a much bigger challenge
On Mar 23, 2015 1:39 PM, "Andreas Madsen"<EMAIL_ADDRESS>wrote:

Yeah, that is the timeout example, that I don't think can be solved.
But if you have:
for (var i = 0; i < 1000; i++) {
fs.open(file[i], 'r', function (err, fd) {
var now = Date.now()
var then = now + 10
while (Date.now() < then);
})
}
setTimeout(function () {
// May first emit after 1000 x 10 ms
}, 20);
then it should be possible to emit a asyncReady event after two fs.open
callbacks (20 ms), as the main thread is not in a blocking state. But the
actual setTImeout callback may first be called after a while (1000 x 10
ms).
—
Reply to this email directly or view it on GitHub
https://github.com/iojs/tracing-wg/issues/11#issuecomment-85185394.

Yeah, that would be fine too. I think it would need some kind of async_wrap flag, as getting timestamps can be a bit expensive.

Don't forget that the _asyncQueue object property should be attached to the this in init. So you can check each individually. e.g.
function init() {
  this._asyncQueue = { init: process.hrtime() };
}

function before() {
  this._asyncQueue.before = process.hrtime();
  // capture time between init and when before was able to run
}

function after() {
  // capture time between before and when after was able to run
}

And if all you want to do is get past the synchronous execution stack then use process.nextTick(). Will only be an exact measurement if it's the first call on the nextTickQueue, but we could work around that in the future. e.g.
function before() {
  var t = process.hrtime();
  process.nextTick(function() {
    // print time difference
  });
}

Now as far as knowing when the call has actually completed, well you're SOL. Receiving the response from the kernel will be blocked until the sync script is done running, so the only way to get around that would be to accept completed requests from another thread so sync execution wouldn't disrupt the time.

@trevnorris Maybe I don't understand the effect of the before + process.nextTick that you are suggesting. But I think you just didn't understand me. Let me try again:
The this._asyncQueue queue trick is how I'm doing it now. It is what I'm referring to when I write beforeTimestamp - initTimestamp. But it is a miss leading number.
To not get misleading numbers, one would need something earlier than before. This early event doesn't have to emit immediately when the non-blocking operation is done, because that is likely impossible. But if there is something in between immediately and before then that it much a much better approximation.
If I understand correctly the order of execution for a event loop turn is:
before[1], callback[1], after[1], before[2], callback[2], after[2], idle

What I'm suggesting is that maybe there is a way to do:
early[1], early[2], before[1], callback[1], after[1], before[2], callback[2], after[2], idle

This will not be a perfect approximation, but it will be a better approximation if callback[1] and callback[2] takes a long time to execute.
To get the same effect using exciting API, one could perhaps use a recursive loop of setImmediate to get the time and then use this time in before[i]. But it would be ridiculous inefficient.

@AndreasMadsen I got you, and that's what my second comment above addresses (about being SOL). The completed requests are queued by the kernel and wait patiently for the event loop to retrieve them. Since the event loop is to busy to retrieve these completed requests from the internal queue, it's also too busy to notify you that the request has been completed. You can only be notified of exactly how long a request took if your script is ready to accept the request from the internal queue. But in that case it'll call the before callback anyway.

@trevnorris Okay, that makes sense. I though the callback queue was maintained by v8. This makes things a bit more difficult :)

@AndreasMadsen The only way around this, to know the exact time of a request, is to perform the request on another thread. Unfortunately that's impossible for a few reasons. If you have any good ideas, let me know, but right now I can't see any way around it.

closing old AsyncWrap issues, please start a new thread if appropriate


Store and reuse financial statements retrieved from TWS

Retrieve the statements from TWS if the locally stored statements are older than 4 months.

Done.


i can't use for angular 1.58 and install by bower

i can't use for angular 1.58 and install by bower

It does work with angular 1.5.8.
Which ui-router are you using? Please note $stateChangeSuccess is deprecated on ui-router 1.0.  However angular-ui-router-styles is using $stateChangeSuccess.  So you will need to include stateEvents.js in your Angular app to keep using $stateChangeSuccess. See here for more detail:
https://github.com/angular-ui/ui-router/issues/2720#issuecomment-216268572

@zhaocnus
my ui-router version is 0.3.2
and I update to version 1.0.0 is still fail
bower say:
bower                                   ECONFLICT Unable to find suitable version for angular-ui-router


Note about upgrading Vagrant for VirtualBox 5+

Leaving this here so that others don't jump to hasty conclusions like I did. :-)
closes #220

Thanks for the PR! We may end up putting this on the (soon-to-be open sourced) website instead of the README. Also, active development for Lattice cluster components is moving to a different repo.

@mikegehard this got closed inadvertently while we're doing some work on our repos.  this content is moving to our website, we'll make the change and it should go out with v0.6.0

@mikegehard We've updated the website to add a note to Troubleshooting. It's not live yet, but will go out with our upcoming release.

Thank you!
On Wed, Oct 21, 2015 at 9:59 AM, Damon Anderson<EMAIL_ADDRESS>wrote:

@mikegehard https://github.com/mikegehard We've updated the website to
add a note to Troubleshooting http://lattice.cf/docs/troubleshooting/.
It's not live yet, but will go out with our upcoming release.
—
Reply to this email directly or view it on GitHub
https://github.com/cloudfoundry-incubator/lattice-release/pull/221#issuecomment-149942699
.