Stolen connections interrupted when application closes sockets on steal mode.

Bug Description
When the user application closes a listening socket, existing connected sockets accepted from that socket should continue.
However, once the agent receives a PortUnsubscribe it removes the iptables redirect, which interrupts existing connections.
This means for example that you cannot successfully run with mirrord on steal mode an application that listens on a socket, accepts one connection, and then closes the listening socket but keeps the connection.
Steps to Reproduce
cargo test -p tests traffic::steal::steal::close_socket_keep_connection::agent_2_Agent__Job -- --nocapture

Backtrace
No response
Relevant Logs
No response
Your operating system and version
macOS 13.4
Local process
python3
Local process version
No response
Additional Info
No response

@t4lz Do we know of a real life scenario where this happens?

@t4lz Do we know of a real life scenario where this happens?

There is the close_socket_keep_connection test that runs an application constructed to trigger this issue, but we don't know of a natural application in the wild that has this issue.


[ Failed ( so far ) ] Attempt to Fix Rendering Artifacts

( Will,  hopefully ) fix issue #3353
PR checklist:

[ ] make succeeds (on *nix)
[ ] make reftests succeeds
[ ] tested examples with the following backends:

I fixed the issues you pointed out and I'm still getting the jagged edges. :confused:

Any other ideas. :slightly_smiling_face:

What if, after we render to the renderbuffer on the main context (in submit), we bind it for reading to a framebuffer, and actually issue a blit to some other FBO? Just to replicate the same scenario that we have on surface context (in present). This would ensure that the image goes through the necessary memory barriers and layout changes under the hood. Of course we don't want to ship that, but it would confirm the theory that there is a workaround, at least.

What if, after we render to the renderbuffer on the main context (in submit), we bind it for reading to a framebuffer, and actually issue a blit to some other FBO?

I'll try that next, but I just found something interesting. I just made a new commit that gets rid of context sharing completely and I'm still getting the same rendering artifacts.
Also, I'm trying to figure out why we need separate contexts for the surface and the root context. Is that because in multi-threading you cannot use the same context across different threads? Being that we can't share anything across extra threads right now anyway because of Starc and such maybe we shouldn't even be sharing contexts at all?
Not that it is helping in this case it seems.

I just made a new commit that gets rid of context sharing completely and I'm still getting the same rendering artifacts.

That's an interesting experiment! We should double-check if the sharing is actually requested at the low level (by debugging through context creation).

I'm not actually sure how to try what you suggested in submit because the framebuffer I would need to bind as the read FBO would be the swapchain FBO which we don't have access to in the submit function. Does the test I already did by getting rid of context sharing cover that test?

Let's do it in present() then. To clarify: this operation is purely artificial and makes no practical sense, it's just to convince the driver to transition the renderbuffer into "readable" state. So, in present() before switching the current context, you could create an FBO and attach the renderbuffer to it, bind the FBO for reading. Then maybe create another temporary RBO, another temporary FBO, attach them, and bind from drawing. Then do a blit.
After that, we can proceed as usual by switch the contexts and doing a real blit.

@zicklag have you tried to make further progress here?

Haven't had the chance to try anything else yet.

What platform are you on? Can you reproduce the rendering issue on the quad example?

I tested this PR without the last commit on both macOS and Linux with a modified quad example and got no issues...

I'm on Linux, but the quad example did work before this PR: only the WGPU Cube example actually exhibits the problem so far.

I think the difference with the cube example is that the latter has a second pass, where it draws edges only, and enables blending. So this is what confusing the driver in our case, and it would be trivial to replicate on gfx's quad example.

Especially with Bevy getting an OpenGL renderer backend which would have been one of my larger use-cases

I'd expect them to happily throw it out if gfx-rs had a working GL backend.
There is also Veloren, which is essentially blocked for wgpu migration on our GL backend.

I think the difference with the cube example is that the latter has a second pass, where it draws edges only, and enables blending. So this is what confusing the driver in our case, and it would be trivial to replicate on gfx's quad example.

Hmm, that would be good to do.

I'd expect them to happily throw it out if gfx-rs had a working GL backend.
There is also Veloren, which is essentially blocked for wgpu migration on our GL backend.

Ahgh, I know. You're going to convince me to keep trying this when I have time. LOL :smiley:

OK, well I'll try to get back to this eventually, then. Right now all my time is going to getting out an 0.2 release of my Arsenal game engine ( which is built on Bevy ). GL support is definitely something we really want for Arsenal so this will probably take priority at some point, but the first goal is for me to get Arsenal working at all.

Sorry, didn't mean to try convincing you. Looks like you got enough on your plate at the moment :) Just wanted to argue/elaborate on why GL backend would still be a strategic goal for us, even if Bevy doesn't use it.

Yeah, no problem man. :D I really do want to get this figured out. We'll figure out it sometime. :+1: It would be amazing to support all of the graphics APIs through one interface.

Bummer. I added wireframe rendering to the quad example, and it still doesn't exhibit the issue.

Do you see artifacts in the quad example with https://github.com/kvark/gfx/tree/gl-test ?
I tried running wgpu's examples on GL with the fixes of your PRs (except for the last commit in this PR, which is temporary), and it's all fine on Linux. Going to do the same on macOS now...
Would be good to resurrect and land this, at least on master. Are you interested to do this? Otherwise, I can pick it up.

Do you see artifacts in the quad example with https://github.com/kvark/gfx/tree/gl-test ?

Just ran it and it looks fine.

I tried running wgpu's examples on GL with the fixes of your PRs (except for the last commit in this PR, which is temporary), and it's all fine on Linux. Going to do the same on macOS now...

Oh, interesting. I'll try it again.

Would be good to resurrect and land this, at least on master. Are you interested to do this? Otherwise, I can pick it up.

I should be able to get it rebased. I'll see if I can do that now, I've got ~20 mins. It shouldn't be too hard.

Unable to test the wgpu's cube example on macOS, getting

thread 'main' panicked at 'Error InvalidOperation executing command: CopyBufferToBuffer(2, 1, BufferCopy { src: 0, dst: 0, size: 580 })', /Users/dmalyshau/Code/gfx/src/backend/gl/src/queue.rs:1184:13
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace

This is unrelated to your PR but unfortunate. Will look into it, not a blocker.

looks like this still needs to be done?

Sorry, it won't let me reply to our comment inline. What still needs to be done?

looks like this still needs to be done?

Sorry, it won't let me reply to our comment inline. What still needs to be done?

It was using client_wait_sync instead of wait_sync, but it looks like you fixed this now :+1:

Could you make a similar PR towards hal-0.6 branch?
I'd be comfortable publishing GL backend with this. Remember that we didn't publish it since hal-0.6 got out. Even if it's partially broken, still more useful than no backend at all.

It was using client_wait_sync instead of wait_sync, but it looks like you fixed this now +1

Ah, cool.

Alright, looks like everything is in place!

Sweet! :smiley:
I haven't tested the WGPU examples yet, but I'll try those out in a sec ( if there's no major conflicts to resolve ). If those don't work for me, it might just be that my driver's goofy. Also it's running the Mesa driver, but I've got a hybrid GPU setup on my machine, so I can choose to run it with the GPU which I didn't realize earlier so I'm not sure if that is the reason for the weirdness. I'll have to try both.

Could you make a similar PR towards hal-0.6 branch?
I'd be comfortable publishing GL backend with this. Remember that we didn't publish it since hal-0.6 got out. Even if it's partially  > broken, still more useful than no backend at all.

Sounds good. I'll do that. :+1:

Oh, yeah, I forgot about that extra framebuffer was only added for surfman. I'll have to gate the code off for the windows version and do that differently I guess.

But we don't need Surfman (and GL backend) on windows at all, since it's not able to support WGL in the long run anyway

Ah, then no reason to pollute the code with extra #[cfg] checks. What do we want to do here? Just disable CI for GL on windows?

Yes, rip out GL on windows completely :)

There that should make CI pass now.

I was worried that the GL error I'm seeing on macOS is really about something broken with the presentation, and just manifesting itself on the next command. But it turns out to be a genuine error of buffer copying. Not sure what's going on there, but we can proceed.
bors r+

Just about out of time now, I'll try to do the hal-0.6 PR and a test of the WGPU examples tomorrow! :slightly_smiling_face:

Thank you! I'll do some more cleanup of the GL backend in master in the meantime.


pydoctor_primer should belong to the pydoctor team

c.f. https://github.com/twisted/pydoctor/issues/816 presumably this belongs here

@tristanlatr do you need any additional permissions?


Add query log

It is set in the configuration file to be changed online.
Fixes #1315
Signed-off-by: Julien Pivotto<EMAIL_ADDRESS>

Request logs still don't belong in application logs.

As stated before in this project, we tend not to reinvent the wheel in this project.
Given that file rotation is usually a solved problem, I think we can:

Not do it ourselve
Reopen the log file upon every reload (that would align us with other softwares). That makes us compatible with e.g. logrotate.

Reopen the log file upon every reload

That seems like a reasonable approach.

Updated to remove the "slow" part ; now we will log all queries independently of their duration.
Added tests to check that we reopen the files and keep them open in case of reload failure
Issue a warning if we can't close previous file (that does not make reload fail)
Added comments in code

I have also added the query log format to the list of things considered unstable so we have the ability to make the format evolve in the future.

Further question @brian-brazil:
Should we add a metric query_log_enabled 1 or 0 ?
Should we log as INFO in the application log the slow query log activation / deactivation / filepath change ?

Should we log as INFO in the application log the slow query log activation / deactivation / filepath change ?

Sounds more debug to me offhand.

Should we add a metric query_log_enabled 1 or 0 ? (could be done as a separated PR)

Makes sense, this may have performance impact.

Thank you @brian-brazil for the review.
Do you think that this should contain API requests too ? I was under the impression that Query Log and Access Logs were different. If we want to log AccessLogs then I need to work outside of the engine too -- e.g. logging admin commands such as DELETE.

If we want to log AccessLogs then I need to work outside of the engine too -- e.g. logging admin commands such as DELETE.

Hmm, we probably should log those too. Probably out of scope for this particular PR though.

I added a naive way of tracking the origin of a query.
I made it so that we can further log when queries come from rules , console template, , etc
for now it is a free map[string]string, maybe we directly should go for a proper Origin struct

I think using the context would be cleaner here, this is per-request information.

Adjusted;  I will do more cleanup and add tests somewhere next week

BTW: With some request ID and logline on the start of invoking query, can we drop an active query tracker? thinking

No, as you wouldn't log queries that are active when you OOMed.

I have been thinking on this one and here is how I plan to continue the implementation:
The promql package will get an interface
type logger interface{
Log(...interface{}) error
}

Then there will be a SetLogger(logger) function added to the engine.
The file opening/gokit logger creation will happen in a third party package, e.g. in pkg/filelogger.
cmd/prometheus/main.go reload functions will include a reload function that will call the filelogger and engine.SetLogger.
That looks to me a good compromise:

not putting too much logic in cmd/prometheus/main.go as it is hard to reuse
not dealing too much with things not related to the engine in the promql package
let third party implement their own logger if needed or reuse our filelogger package
easy split of file tests and logger tests

Give me a few days to move forward with this.

I have updated my pull request, with a better separation of concern. The promql package does not deal with files anymore.
/cc @brian-brazil @bwplotka

Exemple log line:
{"client_ip":"<IP_ADDRESS>","end":"2020-01-07T13:54:16.128Z","query":"vector(1)","start":"2020-01-07T13:54:16.128Z","stats":{"timings":{"evalTotalTime":0.000026106,"resultSortTime":0,"queryPreparationTime":0.000012256,"innerEvalTime":0.000007964,"execQueueTime":0.000002085,"execTotalTime":0.000041266}},"step":"0s","ts":"2020-01-07T13:54:16.160Z"}
With error:
{"client_ip":"<IP_ADDRESS>","end":"2020-01-07T13:56:19.132Z","error":"found duplicate series for the match group {} on the right hand-side of the operation: [{name="up", instance="<IP_ADDRESS>:9090", job="prometheus"}, {name="up", instance="<IP_ADDRESS>:9090", job="prometheus"}];many-to-many matching not allowed: matching labels must be unique on one side","query":"vector(9999) + on () up","start":"2020-01-07T13:56:19.132Z","stats":{"timings":{"evalTotalTime":0.000224988,"resultSortTime":0,"queryPreparationTime":0.000078192,"innerEvalTime":0,"execQueueTime":0.000003185,"execTotalTime":0.000239282}},"step":"0s","ts":"2020-01-07T13:56:19.169Z"}

Should we use a dedupe logger for the errors? That would imply to add another logger to the engine, specifically for the query log errors.

Dedupe logger loses us line numbers, and disk filling up is fatal to Prometheus unlike remote storage going away.

Thanks!

On 09 Jan 00:54, Frederic Branczyk wrote:

I think a blog with examples for logrotate and stdout sounds like a great idea, or a user guide.

Oh yes a user guide sounds even better.

/prombench v2.15.2

/prombench cancel


Capture External apps usage analytics

Summary
Figure out what events/metrics to capture for external apps
Capture events/metrics for external apps

Data points to be captured

No. of clusters connected
No. of users added


Save highscores

For starters, can store 'the highscore' in a txt file (or a json file). Can be updated if required after each game.

I can give it a shot. I would use json file since it's easier to work with.

@mxw7265 Sure! Don't forget to display the high-score somewhere at the top of the screen during the game too.

I should be able to complete this weekend. I am busy at the moment. Sorry!

@mxw7265 there's no hurry. I'm busy too.


Create pull request

Create pull request for merging feature/dark-theme branch into feature/body.

Pull request created.


(iOS) fix: add FirebaseAnalytics pod

PR Type
What kind of change does this PR introduce?

[x] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation  changes
[ ] Other... Please describe:

PR Checklist
Please check your PR fulfills the following requirements:
Bugfixes:

[ ] Regression testing has been carried out using the example project to ensure the intended bug is fixed and no regression bugs have been inadvertently introduced.

What is the purpose of this PR?
Fix ios build, by adding FirebaseAnalytics pod, see https://github.com/dpa99c/cordova-plugin-firebasex/issues/847
Does this PR introduce a breaking change?

[ ] Yes
[x] No

What testing has been done on the changes in the PR?
Local testing of an iOS build.

Thanks, I didn't encounter this problem while testing the v16.2.0 release but I see no harm is explicitly adding the pod so will merge this


typst-lsp fails to connect to language server in VSCode Live Share

Component:

VSCode Extension

Extension version: 0.10.1
LSP version: internal to extension
OS version and name: Void Linux

I am on the latest stable version of the extension/LSP.
I have searched the issues of this repo and believe that this is not a duplicate.

Issue
typst-lsp fails to connect to language server in VSCode Live Share
To reproduce:

connect to another vscode instance via Live Share
open a typst file

Logs
[Info  - 02:35:44] src/workspace/package/external/manager.rs:48 { message = got user external package directory; user = LocalProvider { root: "/home/abi/.local/share/typst/packages/" }; }
[Error - 02:35:44] Server initialization failed.
  Message: Internal error
  Code: -32603
[Error - 02:35:44] Typst Language Server client: couldn't create connection to server.
  Message: Internal error
  Code: -32603
[Info  - 02:35:44] src/workspace/package/external/manager.rs:58 { message = got external package cache; cache = LocalProvider { root: "/home/abi/.cache/typst/packages/" }; }
[Info  - 02:35:44] src/workspace/package/manager.rs:42 { message = initialized package manager; current = {Url { scheme: "vsls", cannot_be_a_base: false, username: "", password: None, host: None, port: None, path: "/", query: None, fragment: None }: Package { root: "vsls:/" }}; external = ExternalPackageManager { providers: [LocalProvider { root: "/home/abi/.local/share/typst/packages/" }, LocalProvider { root: "/home/abi/.cache/typst/packages/" }], cache: Some(LocalProvider { root: "/home/abi/.cache/typst/packages/" }), repo: Some(RemoteRepoProvider { base_url: Url { scheme: "https", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("packages.typst.org")), port: None, path: "/", query: None, fragment: None }, client: Client { accepts: Accepts, proxies: [Proxy(System({}), None)], referer: true, default_headers: {"accept": "*/*"}, timeout: 30s } }) }; }
[Error - 02:35:44] src/server/lsp.rs:56 { message = could not register workspace files on init; err = the provider does not provide the requested URI; }

Was the typst-lsp extension installed on the other VS Code instance? If not, I believe this is expected behavior, poorly reported to the user (but I don't know Live Share well enough to say for sure).


REQUEST / Inquiry Samsung Gear S3

do you have any plans on building client / app for Samsung Gear S3? Or is there anyway to receive Pushbullet notifications on the device (Gear S3) that you might be able to think of?? This is natively without the need of being connected to the synced android via BT. This is because the phone's PB notifications aren't shared on the watch.
the later wouldn't allow you to respond to an iMessage, but at least you would be aware of it and could respond via text / call.
thanks in advance!!

Yeah sorry I don't know -- if you bought me one and mailed it to me I'd check it out though :P
You'd have to go from scratch although the API is really simple. Check out the main class in the server project if you want.


Document the configuration better

I see that #121 is related, but it was closed with a different resolution than perhaps initially intended. My main issue right now is that I can't find any documentation on the config file. A short paragraph about its location and format would do.
My specific issue is that my config file is this:
openai-api-key: <my key>
no-git: true

Yet, even though the OpenAI API works, I can't get Aider to never use git. I've looked through the docs but I haven't found anything that can point me in the right direction about how to configure Aider, a short section would help.

Thanks for trying aider!
I think you probably need to use:
openai-api-key: <my key>
git: false

Thanks, that worked! Could it be documented somewhere perhaps?

The aider --help command includes some docs:
Args that start with '--' can also be set in a config file
(/Users/gauthier/Projects/grep-ast/.aider.conf.yml or
/Users/gauthier/.aider.conf.yml or specified via -c). The config file uses
YAML syntax and must represent a YAML 'mapping' (for details, see
http://learn.getgrav.org/advanced/yaml). In general, command-line values
override environment variables which override config file values which
override defaults.

I did see that, but, strictly speaking, --no-git starts with -- and didn't work when set in the config file.


Add support for mouseEnter and mouseLeave events

First, thank your for this great component.
I was using the component and needed to show more information when hovering the nodes. So I pull this request that adds the mouseenter and mouseleave events to PipelineNodes. Using these, I will be able to show information not just when clicking, but also when hovering.
I also moved the click, moseenter and mouseleave, events from the PipelineNode circle, to its parent  tag. Doing so, you get the events not only when clicking/hovering on the node circle, but also on its LABEL and NAME. I don't know if you agree with this last change.
Hope everything is clear. Thanks in advance.

Great Job! thank you for your effort.

Hi, could you please update these changes in the npm package?
Thanks in advance!

I have update these changes in the npm package. thank you for your remind.


[WIP] Incorporate pypreprocessing's GLM Reporter module into Nistats

In lieu of PR #304
Refactored nistats/reporting.py into nistats/reporting/*.py submodules

Creating room for GLM Reporter functions to be transitioned into
reporting module.
Removed nistats/reporting.py

Hey @KamalakerDadi I have troublt running circleci locally, so the rapid diagnosis of this is not so rapid. You have any idea about this, before I push a bunch of pointless attempts to fix the CircleCI problem. The make clean and make html builds are completing fine.

Hey @KamalakerDadi  I have troublt running circleci locally, so the rapid diagnosis of this  is not so rapid. You have any idea about this, before I push a bunch of  pointless attempts to fix the CircleCI problem. The make clean and make  html builds are completing fine.

I don't completely understand. Your question is why CircleCI is failing ?

Yeah, it says sphinx could not find nistats.reporting.compare_niimgs, which makes sense since I am reorganizing this, but it runs fine on my local machine.

Ok. Let me reproduce and propose an idea.

I think you have refactored reporting.py to a folder. If you add folder name 'reporting' into nistats/init.py then it should be fine. I think.

You added tempita as a dependency but it is missing from the dependencies list.

@KamalakerDadi Thanks ofr looking into this for me.

I think you have refactored reporting.py to a folder. If you add folder name 'reporting' into nistats/init.py then it should be fine. I think.

The PR where I reorganized the reporting module was not raising this bug, and I am pretty sure I didn't add this there either.

You added tempita as a dependency but it is missing from the dependencies list.

Its only a dependency for using GLM Reporter, not nistats. What change should I make?

@KamalakerDadi Importing reporting module into nistats/init.py fixed the malfunction.

@KamalakerDadi I forgot to write, I had to import the function into the glm_reporter/__init__.py as well for this all to work.

Some aspects that are obvious as I work on the examples. We should:

Add a way to auto-generate the keys for contrasts from the design matrix.
Add a way to specify color maps.
Add function to make dict of zmaps.

6 Nistats examples now use GLM Reporter. I will stop here and start creating automated tests out of them, by comparing each generated file against an initial benchmark that @bthirion can validate.
To compare I can use
Python's filecmp module and other built-in file comparison functions (will start here).
Load each file as a binary in numpy array and do an almost equal?
The text files can be compared using the standard hashing algorithms.
The image files can be compared using the same approach or some kind of sci_image functions using MSE or SSIM or using locality sensitive hashing.
Do these approaches work for generated HTML files?
Do I need these approaches or is the bar not that high or there are better methods?
@aabadie @GaelVaroquaux

6 Nistats examples now use GLM Reporter. I will stop here and start creating automated tests out of them, by comparing each generated file against an initial benchmark that @bthirion can validate.

Maybe you don't need to test again 6. one first-level and one second-level should be enough ?
I'm worried about test time.
I would also try to keep the test as light as possible. using a hash is probably a good idea.
I'm wondering whether a smoke test would not be enough ?

small remark : the templates still contain "pypreprocess report", better change to "nistats report" or smthg similar.

It might be useful to have an option to plot contrasts in the reports using plot_glass_brain.

repoter works with Python 2.7, but with 3.7 I get:
(Py37) cp983411@is153352:~/4_code/nistats/kchawla-pi/nistats/nistats/tests/test_glm_reporter/glm_reporter_examples/first_level_models (glm-reporter-attempt2)$ python report_adhd_dmn.py
report_adhd_dmn.py:6: DeprecationWarning: Python2 support is deprecated and will be removed in a future release. Consider switching to Python3.
from nistats._utils.testing import make_reporter_example_result_path
/home/cp983411/anaconda3/envs/Py37/lib/python3.7/site-packages/nilearn/datasets/func.py:503: VisibleDeprecationWarning: Reading unicode strings without specifying the encoding argument is deprecated. Set the encoding, use None for the system default.
dtype=None)
/home/cp983411/4_code/nistats/kchawla-pi/nistats/nistats/first_level_model.py:73: UserWarning: Mean values of 0 observed.The data have probably been centered.Scaling might not work as expected
warn('Mean values of 0 observed.'
Traceback (most recent call last):
File "report_adhd_dmn.py", line 57, in
create_report_adhd_dmn()
File "report_adhd_dmn.py", line 52, in create_report_adhd_dmn
anat=datasets.load_mni152_template(),
File "/home/cp983411/4_code/nistats/kchawla-pi/nistats/nistats/reporting/glm_reporter/glm_reporter.py", line 288, in generate_subject_stats_report
z_maps,
File "/home/cp983411/4_code/nistats/kchawla-pi/nistats/nistats/reporting/glm_reporter/glm_reporter.py", line 354, in _make_activation_thumbnails
z_threshold=threshold, title=title)
File "/home/cp983411/4_code/nistats/kchawla-pi/nistats/nistats/reporting/glm_reporter/glm_reporter.py", line 86, in generate_level1_stats_table
clusters = [c for c in clusters if c['cluster_p_value'] < cluster_pval]
File "/home/cp983411/4_code/nistats/kchawla-pi/nistats/nistats/reporting/glm_reporter/glm_reporter.py", line 86, in
clusters = [c for c in clusters if c['cluster_p_value'] < cluster_pval]
TypeError: '<' not supported between instances of 'NoneType' and 'float'

The report ouput by report_adhd_dmn.py displays the design matrix twice

It was decided that the code is too complx and unnecessary for the functionality and we should write this functionality from scratch. The feedback here is invaluable for me and I will accommodate it into the new PR #352 .


[viewer] - Allow for any model to be exploded

It would be very nice to have a button / slider on the viewer that allows you to explode any model that you are viewing. This would be incredibly useful when trying to understand the architecture of any model as opposed to having to create an explosion animation for any model and then exporting for the viewer.

Great idea. This will require a new function on mesh as well but this should be straightforward

I think we could calculate the center of the mesh and calculate rays from it to the rest of the meshes. Then move them on this ray. Wouldn't that work without adding additional info?

This feature is not a priority for now

Hi David,
Are there no plans to enable this? This is a feature that AutoCad's online
viewer has enabled
On Thu, May 3, 2018, 4:33 PM David Catuhe<EMAIL_ADDRESS>wrote:

Closed #3363 https://github.com/BabylonJS/Babylon.js/issues/3363.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/BabylonJS/Babylon.js/issues/3363#event-1608882235,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADdr6E6M2CRKLQ5dwRLr75Igg52I-Biuks5tu5O8gaJpZM4Q91_O
.

Sorry I thought you did not need it anymore

I have some ideas for this

Wonderful!

https://brave-gates-959b79.netlify.com/
Just my initial thought about breaking a mesh down into multiple meshes.  What do you think?

pinging @eamon-obrien

New example on that link. I'm sure it can be refined and improved.
code is here:
https://github.com/danjpar/babylonjsTesting

PR

Done! Thanks a lot @danjpar !!!


Name video files after annotation_idgloss instead of idgloss

As annotation_idgloss is unique, while idgloss is not.

I found two places in the code to change:

function import_media in dictionary/views.py (when batch inporting videos)
function addvideo in video/views.py (when uploading a video for a gloss)

Then there is the procedure of updating the video file names to the annotation_idgloss.
Is this complete and correct, @Woseseltops and @ocrasborn ?

I would say the main place is https://github.com/Signbank/NGT-signbank/blob/master/signbank/dictionary/models.py#L585 , which is the code that tries to guess the video path/filename based on the (currently) idgloss.

It might be a good idea to have only one place that defines how the file name is constructed, if there are several there is always more room for error.
By the way, are you in some way dependent of the file names being correctly named? Do you have some scripting that works on the video files?

Discussed this one with Micha; as annotation_idgloss will be replaced by a more dynamic multi-lingual system, this issue no longer makes sense. Close if you agree, @ocrasborn

I don't agree (it's unrelated; the point is that the movies are linked to unique glosses, where Lemma ID Glosses can re-occur for multiple movies/annotation glosses.
We agreed that we'll close this for now, as the file names of the movies remain unique as they are combinations of gloss + id number.


NPE in SocketChannelIOHelper.read

Hi.   We are using java websockets and on the server side while using ssl we are first getting and onError call with socket=null...i.e. tis WARN from our code
2016-10-01 13:26:58,715 | WARN  | socketSelector64 | http                             | 72 -  | WebSocketListener.onError socket=null
This is immediately followed by a stack trace from inside java websockets
java.io.IOException: An existing connection was forcibly closed by the remote host
at sun.nio.ch.SocketDispatcher.read0(Native Method)[:1.8.0_101]
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43)[:1.8.0_101]
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)[:1.8.0_101]
at sun.nio.ch.IOUtil.read(IOUtil.java:197)[:1.8.0_101]
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)[:1.8.0_101]
at org.java_websocket.SSLSocketChannel2.processHandshake(SSLSocketChannel2.java:116)[71:java_websocket:<IP_ADDRESS>512181726]
at org.java_websocket.SSLSocketChannel2.(SSLSocketChannel2.java:75)[71:java_websocket:<IP_ADDRESS>512181726]
at org.java_websocket.server.DefaultSSLWebSocketServerFactory.wrapChannel(DefaultSSLWebSocketServerFactory.java:39)[71:java_websocket:<IP_ADDRESS>512181726]
at org.java_websocket.server.WebSocketServer.run(WebSocketServer.java:317)[71:java_websocket:<IP_ADDRESS>512181726]
at java.lang.Thread.run(Thread.java:745)[:1.8.0_101]
This is followed by another onError socket=null call in our code...i.e.
2016-10-01 13:26:58,715 | WARN  | socketSelector64 | http                             || WebSocketListener.onError socket=null
and then this NPE in java websockets occurs
java.lang.NullPointerException
at org.java_websocket.SocketChannelIOHelper.read(SocketChannelIOHelper.java:12)[71:java_websocket:<IP_ADDRESS>512181726]
at org.java_websocket.server.WebSocketServer.run(WebSocketServer.java:327)[71:java_websocket:<IP_ADDRESS>512181726]
at java.lang.Thread.run(Thread.java:745)[:1.8.0_101]
Which seems particularly bad because it might affect the proper running of the WebSocketServer.run thread.
Sometimes the first stack trace appears above, and it's not followed by the second.
This is using a version/copy of java websockets built on Dec 18, 2015.
Any insights or suggests for collecting of other information to figure out what's going wrong here?
Thanksinadvance.  Scott

Hello @scottslewis,
sorry for the delay. I am trying to get through all the old issues!!
Does the NPE still exists when you build your jar from the current master?
Greetings
marci4

2 months of no feedback.
Cant reproduce this issue!
Closing it.
Greetings
marci4


optimize the e2e setup

use a makefile variable=false to install opencruise , rdma things , but turn on it in the github CI

Yes, it will be completed within this time


Add 'Clear all transactions' button to Desktop wallet

We have this on mobile and it is very useful in certain cases. Let's add it in Desktop wallets as well.
Also we should consider maybe using the word 'Clear' instead of delete?

Add "trashcan" icon https://zpl.io/VKeL5p7
Confirmation popup https://zpl.io/adgwWXL


Analytical fluid flow, short bearings

Add analytical fluid flow routines for short bearings, related to issue #65

I am going to merge this now.
Regarding the matplotlib plots, I think we need to debate if we will use only bokeh or if we are going to provide both options. My only doubt is if with bokeh we can generate plot files that are ok for publication (svg or pdf?).


Add schema generation benchmarks for models with custom serializers

Change Summary
This PR expands the benchmark suite by adding "schema generation" benchmarks in the following cases:

Models with custom field serializers (decorator and annotated)
Models with custom model serializers

I am open to suggestions.
Related issue number
Contributes to #9711
Checklist

[ ] The pull request title is a good summary of the changes - it will be used in the changelog
[ ] Unit tests for the changes exist
[ ] Tests pass on CI
[ ] Documentation reflects the changes where applicable
[ ] My PR is ready to review, please add a comment including the phrase "please review" to assign reviewers

@sydney-runkle I created benchmarks for the custom serializer case in schema generation and incorporated some of the cool parametric features that you added to your refactor. Very cool stuff!
Let me know if there is anything else you want added to this PR or if there is some issue I'm not seeing.

Great work @AdolfoVillalobos, thanks for the consistent progress here!


Adding Samvera::Derivatives interface and Hyrax shim

Adding Samvera::Derivatives for interface discussion
53e80f5be889744674bad45cd0476b0497f55d58
This commit begins to define an interface for the separation of concerns
regarding the long-standing implementation of Hydra::Derivatives and
Hyrax::FileSetDerivativesService as those relate to the
existence of pre-existing derivatives.
This does not address the implementation details related to Bulkrax
handling this work.  I would instead assume that Bulkrax would implement
a subclass(es) Samvera::Derivatives::FileLocator::Strategy, which
would in turn address the specific needs and implementation details.
As I've explored the implementations, a challenge of Hydra::Derivatives
is that is combines the concern of finding the derivative (by making it)
and applying that derivative to the corresponding file set.
Also, there is a higher level concern that is not addressed in this
implementation; namely what are the derivatives of concern for a
given FileSet; something that is likely based on the mime_type of the
original file and metadata from the parent work.
Why not create another gem?

The immediate need is Bulkrax related.
The plumbing is laid for Bulkrax's test suite.
We probably don't need another gem to triangulate for a general
solution.

That said, I am name spacing this interface in Samvera so if we find
it useful we can extract a samvera-derivatives gem.  After all, not
everyone's going to want Bulkrax.
Why not put this in Hyrax?

Because Bulkrax works across many different Hyrax versions.  Thus by
being in Bulkrax it is generally more available than if it were in
Hyrax; something which we'd need to backport.

An advantage of establishing the interface is that work can be done to
now "fan out".  That is someone can work on a locator strategy while
another works on the applicator strategy.
Related to:

https://github.com/samvera-labs/bulkrax/issues/760
https://github.com/scientist-softserv/utk-hyku/issues/343

Introducing location concept to Samvera::Derivatives
42df4dfa13dab7c737e12bb0931d6fdc99b2d395
Prior to this commit, I was passing an array of strings back from the
locator.  With that pathway, I was ignoring how the existing
Hyrax::FileSetDerivativesService would likely be used as a fallback.
With this commit, I'm beginning to account for how that interaction
would be; in part by focusing on a known use case and building the
interactions accordingly.
This commit stencils in the expected behavior in what I think is
adequate to convey intention and design.
Related to:

https://github.com/samvera-labs/bulkrax/issues/760
https://github.com/scientist-softserv/utk-hyku/issues/343

Adding Samvera::Derivatives::Hyrax consideration
e33e454d21bcc35ee136cc33fb05a8d82db86bab
With this commit, I begin demonstrating how the original configuration
can be leveraged to do the derivative work.  This still assumes a
configuration for derivatives; something that I continue to punt on
until I have more concrete code that I can further build from.
Related to:

https://github.com/samvera-labs/bulkrax/issues/760
https://github.com/scientist-softserv/utk-hyku/issues/343

I’m curious why this isn’t happening in iiif-print where we already massively modify the derivative process?

Moving this to IIIF Print


ComboBox with IsEditable="true" can get unselected when navigating away

Describe the bug
If a user clicks away from an editable combo box without selecting a value, the selected value is cleared.
Steps to reproduce the bug
<ComboBox
    x:Name="MyComboBox"
    IsEditable="True"
    Loaded="ComboBox_Loaded">
        <x:String>20</x:String>
        <x:String>40</x:String>
        <x:String>60</x:String>
</ComboBox>

private void ComboBox_Loaded(object sender, RoutedEventArgs e)
{
    this.MyComboBox.SelectedItem = "40";
}

When the application launches, click the drop down arrow to open the combo box, then click away.
Expected behavior: "40" is still selected
Actual behavior: nothing is selected
This behavior occurs only if the ComboBox has IsEditable="true", and only when the ComboBox is first loaded.
Version Info
Windows 22000, occurs with or without WinUI 2 present

@StephenLPeters I see this is marked as "needs-winui-3". Because of the number of issues we're seeing with ComboBox in our "font picker" scenario (see #5733, #5734, #5735), we'd be very interested in seeing a revised version of ComboBox in WinUI 2. Is a WinUI 2 port for this control something that you'd consider, or accept a contribution for?

@mcooley The issue is that this behavior is dictated by the comboBox's code behind, not its visual template.  Sometimes we can fix issues with a simple retemplate that we publish in Winui2 however in this case this issue isn't possible to fix that way.  So we have 3 options.

We could fix the issue in the code behind in the OS. The issue here is that the fix is OS bound meaning that it won't actually fix the issue for the majority of users until they update to the new OS version. Additionally there is significant overhead with cracking the OS and thus the team very rarely finds this solution acceptable.
We could fix the issue in Winui3.  This is our default for issues like this. Winui3 is in active development and is the teams vision for the future.
We could publish a brand new control with the same name as ComboBox. So Controls:ComboBox and ComboBox would be different code behinds.  This is what you are suggesting as a possible fix, however it is a significant ask.  Recreating this control has a huge cost and is not something we can afford right now (@ranjeshj can confirm).  We could discuss accepting a contribution of this, however the initial development cost is not the only expense the team is worried about.

@ranjeshj FYI

This is still broken, nearly two years later.

@mcooley, thank your for reporing this. Unfortunately we are not currently investigating WinUI2 issues that are not business or security critical (more on the policy here).
We believe this is fixed in WinUI3 - cannot repro on WASDK 1.5 and latest WinUI3 Gallery.


[image_picker] 🚧 Add support for web 🚧

Description
This is a first pass at a version of the Image Picker plugin for web. There's a few changes:

Add a new cross-platform type to handle both dart:io and dart:html use cases: PickedFile. Thanks for the inspiration @rodydavis!
Add new methods to the ImagePicker Platform Interface API that return PickedFiles, and not "String" or dart:io "File".
@Deprecate old methods with references to the current ones.
Modify the example to use the new API.
Add a web implementation of the plugin.

It uses createObjectUrl so we don't need to load bytes manually, the browser keeps a reference to the picked files for when we need them, and data from those files can be accessed through a "network" request.

Demo
https://dit-picker-tests.web.app
Missing things / Known issues / Limitations

Unit/Integration Tests
Is there any opportunity to add revokeObjectUrl to free resources in the browser? This might be a memory leak in long-lived apps.
Safari is misbehaving with videos, but it should work (this might be a bug in the VideoPlayer plugin for web).
Also when taking pics on an iPhone, the aspect ratio is lost, and every pic is rendered in "landscape" :/
In general, only videos that can be opened directly by the browser can be previewed. There's no client-side transcoding of any kind. Not sure if this is detectable, but it'd be a nice exception to throw!

Related Issues

https://github.com/flutter/flutter/issues/36281
https://github.com/flutter/flutter/issues/53283

Checklist
Before you create this PR confirm that it meets all requirements listed below by checking the relevant checkboxes ([x]). This will ensure a smooth and quick review process.

[x] I read the Contributor Guide and followed the process outlined there for submitting PRs.
[ ] My PR includes unit or integration tests for all changed/updated/fixed behaviors (See Contributor Guide).
[ ] All existing and new tests are passing.
[ ] I updated/added relevant documentation (doc comments with ///).
[ ] The analyzer (flutter analyze) does not report any problems on my PR.
[x] I read and followed the Flutter Style Guide.
[x] The title of the PR starts with the name of the plugin surrounded by square brackets, e.g. [shared_preferences]
[ ] I updated pubspec.yaml with an appropriate new version according to the pub versioning philosophy.
[ ] I updated CHANGELOG.md to add a description of the change.
[x] I signed the CLA.
[x] I am willing to follow-up on review comments in a timely manner.

Breaking Change
Does your PR require plugin users to manually update their apps to accommodate your change?

[x] Yes, this is a breaking change (please indicate a breaking change in CHANGELOG.md and increment major revision).

The change is breaking, but backwards compatible. Users will need to migrate their apps to a new (non static) API, and a new return value from the plugin.

(The Googlebot comment is not very relevant to this PR, since this is not what's going to be merged. This is the POC with all the changes required, that will be split into 3 PRs that need to be merged in order.)

@ditman demo looks perfect.  nice work!

Currently writing tests for the image_picker_for_web package.

@ditman also added a new method and updated the example: https://github.com/ditman/plugins/pull/366
I added this so in the future it would be easy to add to return types and combinations. For example we could add "imageVideo" as a return type to support the gallery picking any file and furthermore we could add  "file" for picking documents.
This will greatly cut down on the boilerplate for the developer as more types are added.

please make anyone video on image_picker_web .actually i want to use this but i don't know how to use this.

Hey @rodydavis, can you please hit https://github.com/flutter/plugins/pull/2791 with a message of consent towards the Googlebot? Thanks!

Thanks guys, you're awesome ❤

Sure think 😎 and thanks @ditman for doing this PR!

I check the demo on an iPhone -> OK
But on chrome on MAC the camera is not started (can not take a picture from my MAC)

@fvisticot correct; desktop browsers don't support the capture attribute. I've updated the README of the plugin to reflect this, here. Look at the "input file 'capture'" section.
Once the camera plugin is ported to the web, we could wire everything together in a big example that knows what's the best way of taking a picture, depending on the platform!

The latest version of image_picker (that uses the new API, and enables the web version) has just been published: v0.6.7
It contains information on migrating from the old API to the new one, after the deprecation of pickImage, pickVideo and LostDataResponse.
https://pub.dev/packages/image_picker#deprecation-warnings-in-pickimage-pickvideo-and-lostdataresponse

Published the PR introducing the web version of the plugin here: https://github.com/flutter/plugins/pull/2802

Closing in favor of: #2802

can someone give an example of how to make a common code for mobile and web for image picker??

can someone give an example of how to make a common code for mobile and web for image picker??

Hello, i'm interesting about this example too :)
I think it's an line like :
pickedFile = await _picker.getImage(source: ImageSource.gallery);
but it's not work in web.
I will waiting the new merge :)


Updated PatternFly to v3.11.0

@chriskacerguis @AllenBW do we need to do the same in https://github.com/ManageIQ/manageiq-ui-self_service/blob/master/bower.json ?

@chessbyte they can update it too, yes.

@chessbyte Yes, there is a PR for it
https://github.com/ManageIQ/manageiq-ui-self_service/pull/135

@chessbyte Well, "need" no...but, a REALLY, REALLY good idea.


How many pieces of language material do I need to fine-tune the model?

I currently want to train a model in my own field based on the 7b model of LLaMA and the LORA strategy based on the alpaca 52k dataset, and then I want to know how much data I need to prepare to realize the training of my own model?

I don't think there is a definitive answer to that.
You could either add your instructions to alpaca and train with the extended dataset, or train with your dataset only, starting with an Alpaca LoRA  (What I do, from a large enough LoRA https://huggingface.co/Angainor/alpaca-lora-13b).
Then it may depend on how different what you want it to learn is different from Alpaca, both in terms of content and instructions.
If you keep the instructions diverse and close to the alpaca ones, something like 100 samples per instruction can be enough.
If you have many new domain specific facts to learn, x10 or x100 that maybe.
(Just my 2 cents from my own experimentations)

I don't think there is a definitive answer to that.
You could either add your instructions to alpaca and train with the extended dataset, or train with your dataset only, starting with an Alpaca LoRA (What I do, from a large enough LoRA https://huggingface.co/Angainor/alpaca-lora-13b).
Then it may depend on how different what you want it to learn is different from Alpaca, both in terms of content and instructions. If you keep the instructions diverse and close to the alpaca ones, something like 100 samples per instruction can be enough. If you have many new domain specific facts to learn, x10 or x100 that maybe. (Just my 2 cents from my own experimentations)

@AngainorDev Question regarding epochs. Noticed your 13b model trained for 10 epochs, and no validation set?
Did you continue to see the loss go down past 3 epochs?  Is your thought that by allowing fine-tuning of all 4 lora modules, 3 epochs is not enough?

Did you continue to see the loss go down past 3 epochs? Is your thought that by allowing fine-tuning of all 4 lora modules, 3 epochs is not enough?

Yep, see the loss graph on HF, I uploaded the pic.
Loss begins to flatten at epoch 10 only.
More module + higher rank = more params
more params = more steps needed.
I take the loss curve as a first order approx of the training success.
When doing extra training, from this same 13b, r16, 4 modules alpaca with a custom dataset of mine, 1000 high quality samples only, different instructions set from alpaca, I had to push to 20 epochs to see the loss flatten, final loss around 0.45
I save every epoch instead of by steps, so I have all epochs, can evaluate each epoch on a custom eval set once done, and continue training with full optimizer state if needed. There I did 10 + extra 10 for instance
After this second fine tune (lora 13b from the HF, used as contuinue_from_checkpoint with my custom ds) the model still is able to work as Alpaca.
It also can understand instructions that were not in the dataset, and are a mix of alpaca and custom instructions.
When doing the same earlier, with smaller and 3 epochs models, the model after fine tune was ok for the new tasks, but forgot too much about alpaca and llama, ending up in lesser generalization capabilities.
Generally speaking, and given the scaling laws from cerebras/chinchilla for instance, I believe there is in fact such a relationship between number of params to be trained, and tokens to provide for optimal training.
So I think yes, more layers or higher rank need more tokens: either more data, either more epochs.
Not a formal proof, just my work hypothesis and feelings from my own tests.


[#83] Create UI test example for Detail screen

#83

What happened 👀
Add Detail screen UI test
Insight 📝

With current implementation, we cannot mock the error from repository. That is why, in order to test loading, we need to assert the loading node without initializing ViewModel.

Above method won't work if we want to assert pull to refresh

Proof Of Work 📹
https://user-images.githubusercontent.com/32578035/217153428-a87837c9-a91b-4bf0-a1a8-c0737478d9bf.mp4

FYI: I will update some tests for UnitTest to make it match with the UI Test in this PR 🚀


how to manage multiple API's call synchronously using AFJSONRequestOperation

Hello,
I am using AFJSONRequestOperation to execute my API.
In my project, i am calling multiple APIs (4 or 5) asynchronously using AFJSONRequestOperation but now i want to make a queue for this... means i need to call those API one by one without blocking my UI...because i need to check OAuth Expiry error and prevent other APIs calls if i am getting expiry error..

This is type of question is best suited for stackoverflow. Github is for reporting bugs and feature requests.
:beers:

From our Contribution Guidelines
Asking Questions
We don't use GitHub as a support forum. For any usage questions that are not specific to the project itself, please ask on Stack Overflow instead. By doing so, you'll be more likely to quickly solve your problem, and you'll allow anyone else with the same question to find the answer. This also allows maintainers to focus on improving the project for others.


changes to how ping server works

This creates the ability to turn the ping check off since icmp isn't always available. It also provides tunable variables that can be used to customize the check. Fixes issue #1


Route To Get Days Difference

Currently I calculate days difference on the frontend. I want to move this to the backend. The route needs to handle all states/countries in one GET.
There can also be a choice of how many days difference to get. For example we could get the difference in the last day for each state/country or we could get the difference in the last 7 days for each state/country.
One option: this would move all calculation to the BE which would be nice and fast

parameters sent to backend: State/Country object, days difference, property name(maybe, will start by just doing active)

State/Country object: This would come in as a LinkedHashMap(to keep order) that would look like this

{
   alabama: 'Alabama',
   alaska: 'Alaska',
   arizona: 'Arizona',
   etc...
}

We could then build a map where the key is state/country name and the value is the difference

{
   Alabama: 1200,
   Alaska: 1000,
   Arizona: -500
}

Another easier option: This would keep calculations on the FE, but the network data should still be pretty small.

Return the most recent DB entry and the one that is daysDifference away

https://github.com/bhaden94/covid-19-tracker-v2-fe/issues/33

Closed with PR https://github.com/bhaden94/Covid19-tracker-V2-API/pull/15


Use rotate_180 rather than right_roll in dSight portrait mode.

right_roll property is ignored. Use rotate_180 instead.

Looks like 1 and 180 do the same thing. I can change it to 1 though if that's clearer. Still waiting to confirm the dsight configurations are correct.

please do - then it matches the schema


[Feature Request]: Favicon is missing for the website

Is there an existing issue for this?

[X] I have searched the existing issues

Feature Description
Favicon is missing for the website and it would be much better if we have the favicon as the ambulance logo which is in the navbar of website.
Use Case
Favicon is necessary for any websites that play a key role to find it across many other opened websites in the browser.
Benefits
Favicon is necessary for any websites that play a key role to find it across many other opened websites in the browser.
Kindly assign me this issue under Hacktoberfest2024.

Priority
Medium
Record

[X] I agree to follow this project's Code of Conduct
[ ] I'm a GSSOC contributor
[X] I want to work on this issue
[X] I'm willing to provide further clarification or assistance if needed.

assigned already


handle empty runtime version in app settings in function-runtime comp…

…onent. Fixes #1308

:shipit:


Failing to build on OS X

When I try to build on mac using make build -j2 as described in the manual, I get the following error
make: *** No rule to make target `build'.  Stop.

I am not overly command-line fluent (so apologies if I'm missing something simple) but I've tried to follow the instructions and can't get anywhere.
Using cmdstan-2.9.0
I'm on OSX 10.11.4
Make 3.81
g++ 4.2.1
Current Version:
v2.9.0

Sorry, this was my fault. I was copying and pasting the line
make build -j2

from the manual, which gave the error. But typing it in manually worked. Sorry about he false alarm. I'm now up and running.

Thanks for reporting.  The comment indicates a problem that should be fixed, so I created a new issue citing this one:
https://github.com/stan-dev/cmdstan/issues/348


When there are a lot of words over an image it's hard to know where to click

In an example like this, it's hard to know where to click because there are a lot of words and it looks like all you can do is click on the words.

Came here to log this issue too!

Fix would be to make long titles abbreviate more aggressively, and/or disable showing the creator in search results (as suggested by #127) which would also reduce the amount of text in a result.

Is there a way to make the words hyperlinked? I kept trying to click on the words thinking they would be a hyperlink

I couldn't get that to work while still keeping the creator links hyperlinked, which might be another argument against keeping those links.

I made some design changes here to tighten things up:

Smaller font size
Truncates title more aggressively
Changed 'Title by Creator' to 'Title, Creator' (to save 3 characters)
Removed the hyperlink to creator
Made the text link to the image detail
Left-aligned the credit (looks better in cases where the image is narrow or it was line-breaking at just one or two words)

There are still a few hyperlink dead spots in the result overlay that might be nice to clean up in the future, but this should be an improvement.


debugger fails to start - help further debugging that

I'm not sure where else to Google/DuckDuckGo my problems or what other logging, etc. to turn on.  I'm trying to get the LLDB (but GDB would be fine too) debug adapter to work on some C code.  I get this in the debugger console log:
[2021-10-07T18:21:04.041Z ERROR codelldb::dap_codec] Could not deserialize: data did not match any variant of untagged enum ResponseResult

[2021-10-07T18:21:04.041Z ERROR codelldb::terminal] channel closed
[2021-10-07T18:21:04.041Z ERROR codelldb::debug_session] shared_session.ref_count=4

And in the Sublime console window I have this:
<Debugger.modules.dap.session.Session object at 0x104cd40d0>
Starting process: ['/Users/inacio/Library/Application Support/Sublime Text 3/Packages/Debugger/data/adapters/lldb/extension/adapter/codelldb', 'terminal-agent', '--port=52001']
Debugger: [2021-10-07T18:21:04.041Z ERROR codelldb::dap_codec] Could not deserialize: data did not match any variant of untagged enum ResponseResult

Debugger: [2021-10-07T18:21:04.041Z ERROR codelldb::terminal] channel closed
[2021-10-07T18:21:04.041Z ERROR codelldb::debug_session] shared_session.ref_count=4

<Future pending>
Traceback (most recent call last):
  File "/Users/inacio/Library/Application Support/Sublime Text 3/Packages/Debugger/modules/core/sublime_event_loop.py", line 14, in __call__
    self.callback(*self.args)
  File "/Users/inacio/Library/Application Support/Sublime Text 3/Packages/Debugger/modules/core/core.py", line 58, in done
    exception = task.exception()
asyncio.exceptions.CancelledError
Debugger: Nothing to read from process, closing
finished

and my debugger configuration looks like:
	"debugger_configurations":
	[
		{
			"name": "LLDB PrettyKate",
			"type": "lldb",
			"request": "launch",
			"program": "${workspaceFolder}/src/prettyKate",
			"args": ["-c", "${workspaceFolder}/tests/unimplementedFunc.lua"],
		},
		{
			"name": "PrettyKate GDB",
			"type": "gdb",
			"request": "launch",
			"program": "${workspaceFolder}/src/prettyKate",
			"args": ["-c", "${workspaceFolder}/tests/unimplementedFunc.lua"],
		}
	],

and my debugger.sublime-settings:
//{
//      "adapters_custom" : {
//              "ggdb" : {
//                      "/opt/local/bin/ggdb" : ["p", "-arg"]
//              }
//      }
//}
{
        "lldb.show_disassembly": "auto",
        "font_face": "Fira Code",
        "log_info": true,
        "should_log_info": true,
}

I did do the test of getting this configuration to work on VSCode with the only change being ${workspaceFolder} to be the absolute path.  That didn't change anything in Sublime when I tried it.  I have Sublime 4113 installed if that matters.  I'm fine with trying to debug this more, but I'm not sure where to look.  Adding should_log_info came from reading these open bugs.  I hope this is the place to put this, I couldn't find a forum, etc. to ask in.

Oh I see the issue the problem. For now adding "terminal": "console", to your configuration should fix the issue.

First, thank you, that fixed it.
Just so that this is complete, if other people manage to find it:
vscode-lldb version is 1.6.7
MacOS 11.6
I'll try to get 1.6.8 installed ASAP.  It doesn't want to try behind the corporate firewall…


Filtering OrganizationUser's by Organization

There is a relatively similar thread on this topic, but I can't seem to figure out how to translate it to my situation. I have a roster that I need to only display the organizationusers within the same organization of the viewer. I have a webapp that I am developing that is used to manage volunteers in an organization. This package is perfect for what I need, but I'm still new to backend development so I'm having trouble problem solving.
This is the code for the table view using Django_Tables2 package:
#tables.py
class VolunteerTable(tables.Table):
    class Meta:
        model = OrganizationUser

# views.py
def VolunteerRoster(request):
    table = tables.VolunteerTable(OrganizationUser.objects.all())
    return render(request, 'staff/roster.html', {'table': table})

I'm trying to figure out how to either convert the view to a class-based view so I can use the OrganizationMixin and the SingleTableView in Django_Tables2's documentation.
I was thinking about something like this based on the other threads explanation
class VolunteerRoster(SingleTableView, OrganizationMixin):
    table_class = VolunteerTable
    queryset = OrganizationUser.objects.all()
    template_name = "staff_roster.html"

    def get_queryset(self):
        return self.queryset.filter(organization=self.get_organization())

When I try this I get: "TypeError: init() takes 1 positional argument but 2 were given"
As I said, I'm still new to django so I'm not really sure what to fix in this instance.

Howdy! After a brief foray into the Django_Tables2 docs, I think much of what you're trying to solve for is specific to that package.
Which is to say I'd like to help here, but I don't think it's really in the scope of this package.
Your last example looks good, so without a stacktrace it's hard to know what the problem is... have you tried changing the order of parent classes (which affects what's called the MRO)?
Otherwise if you have a full stacktrace that would help.

Thanks for the response! I wasn't sure if you would answer.
Would it be possible to just remove django_tables2 and use a regular html table with django-templates tags? In theory wouldn't this be possible with the organiations functionality?

The short answer (two months later - sorry!) is that you don't need a special library to list organizations and their users. Front end libraries may be helpful for rendering sortable or filterable tables, but for the data itself I don't think you need such a library.


IMN-222 Testing upgrade agreement

Close [IMN-222]
Description
This PR add tests for upgrade agreement method and introduce some changes in upgrade agreement logic.
UpgradeAgreement logic updates
In the case where declared and verified attribute of tenant are valid, it copy consumer document files for the new created agreement, using the path CONSUMER_DOCUMENTS_PATH/AGREEMENT_ID/DOCUMENT_ID/DOCUMENT_NAME, in the same way of secondary success case.
Bugfix
Also this PR apply two bugfix on agreement-upgrade
1⃣ during execution copy descriptor's file destination and source path were inverted
2⃣ during AgreementConsumerDocumentAdded event creation the version number starts with wrong number; in detail:
The list of descriptorDocumentAdd events starts with version number 1 and increase with each document in descriptor, but createEvent in event-repository checks pair [stream_id - version_id] not already exists, if not using default value 0 otherwise using next version number;
In our case the pair [agreement_id - version 1] not exists yet (version number 1 was hardcoded during event creation), so it throws "duplicate key exception" when try to store event in store DB with [agreement_id - version 0] that was already stored by agreementAdded event.
3⃣ Remove duplicated log during Agreement creation flow
Test
✅ Integration test succeeds

Create Agreement

Active Agreement

Descriptor not already created

Agreement Upgraded

Two document files are created in Minio

New Agreement created

Since you are fixing the issue here, add also that it closes https://pagopa.atlassian.net/browse/IMN-499


rclone 1.38 hangs on b2_authorize_account

On linux arm 32bit rclone v1.38 and v1.38-052-gf60e2a7aβ both hang when attempting b2_authorize_account:
rclone-v1.38-052-gf60e2a7aβ-linux-arm/rclone -vvvv --dump-headers --config rclone.conf lsd b2:
2017/11/04 01:11:26 DEBUG : Using config file from "/root/rclone.conf"
2017/11/04 01:11:26 DEBUG : rclone: Version "v1.38-052-gf60e2a7aβ" starting with parameters ["rclone-v1.38-052-gf60e2a7aβ-linux-arm/rclone" "-vvvv" "--dump-headers" "--config" "rclone.conf" "lsd" "b2:"]
2017/11/04 01:11:26 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/11/04 01:11:26 DEBUG : HTTP REQUEST (req 0x11144c00)
2017/11/04 01:11:26 DEBUG : GET /b2api/v1/b2_authorize_account HTTP/1.1
Host: api.backblazeb2.com
User-Agent: rclone/v1.38-052-gf60e2a7aβ
Authorization: XXXX
Accept-Encoding: gzip

2017/11/04 01:11:26 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

There is no more output after this and rclone does not exit. I have waited up to 20 minutes without success. The result is the same for v1.38.
The same command with v1.37 executes without error and lists the buckets in my b2 account within 5 seconds of executing the command.

I will also add that the same command with v1.38 on linux x86-64 works without issue.

I can confirm this issue. It not only occurs with b2 accounts, at least also Google Drive.

@HptmHavoc  - are you using arm-32 bit also?
@freespace I think the major difference is that 1.37 was compiled with go 1.8 and 1.38 with go 1.9.
I've attached a version of rclonev1.38-084-gb27e4ec3 compiled with go 1.8 - can you compare and contrast with the latest beta please?
rclone.gz

@ncw - yes, i am also using arm-32 bit.
I was able to test rclonev1.38-084-gb27e4ec3 compiled with go 1.8 and can confirm that it works.
 See g.co/p3phelp for more info."
P3p: CP="This is not a P3P policy! See g.co/p3phelp for more info."
Pragma: no-cache
Server: GSE
Set-Cookie: NID=116=K-ZeyFerqtJuQbC4kLk6-MvnekxlvIo0rCa_2miZOf7H0-G6w0yAhj7zolvlovc-bP8ywwcbNIPT8vYzj9BKaGbxWv8sa9ZfnVmw3wzMLmkL3I1dM1p9b4npxeLi_a-5;Domain=.google.com;Path=/;Expires=Mon, 07-May-2018 21:04:20 GMT;HttpOnly
Set-Cookie: NID=116=ul0q9w5gAkiFGoFgsxBXydivbpDcLp_irfFzCStPhiFUSrQOQVZoWTTBNqbYCRW7pdLiABSpT5Dtge5u_9rG0zMVlkWoB-HUzPYcdcMuPSUj7G8o1F0y4tbCOtRNf62c;Domain=.google.com;Path=/;Expires=Mon, 07-May-2018 21:04:20 GMT;HttpOnly
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Robots-Tag: noindex, nofollow, nosnippet
X-Xss-Protection: 1; mode=block

2017/11/05 21:04:20 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
          -1 2017-09-09 15:58:40        -1 Folder1
          -1 2017-10-01 10:11:35        -1 Folder2
          -1 2017-09-09 15:58:51        -1 Folder3
2017/11/05 21:04:20 DEBUG : Go routines at exit 6
2017/11/05 21:04:20 DEBUG : rclone: Version "v1.38-DEV" finishing with parameters ["./rclone" "-vvvv" "--dump-headers" "--config" "/home/user/.config/rclone/rclone.conf" "lsd" "googledrive:"]

@ncw thank you for providing a version of 1.38 compiled with go 1.8. I can confirm that on the same machine the version you provided works as expected
./rclone -vvvv --dump-headers --config rclone.conf lsd b2:
2017/11/06 01:46:03 DEBUG : Using config file from "/root/rclone.conf"
2017/11/06 01:46:03 DEBUG : rclone: Version "v1.38-DEV" starting with parameters ["./rclone" "-vvvv" "--dump-headers" "--config" "rclone.conf" "lsd" "b2:"]
2017/11/06 01:46:03 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/11/06 01:46:03 DEBUG : HTTP REQUEST (req 0x11221400)
2017/11/06 01:46:03 DEBUG : GET /b2api/v1/b2_authorize_account HTTP/1.1
Host: api.backblazeb2.com
User-Agent: rclone/v1.38-DEV
Authorization: XXXX
Accept-Encoding: gzip

2017/11/06 01:46:03 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/11/06 01:46:06 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/11/06 01:46:06 DEBUG : HTTP RESPONSE (req 0x11221400)
2017/11/06 01:46:06 DEBUG : HTTP/1.1 200 OK
Content-Length: 354
Cache-Control: max-age=0, no-cache, no-store
Content-Type: application/json;charset=UTF-8
Date: Mon, 06 Nov 2017 01:46:05 GMT
Server: Apache-Coyote/1.1
...
<snip>
...

I also tried the latest beta, rclone-v1.38-090-g72072d7dβ, same behaviour as before: rclone simply hangs:
./rclone-v1.38-090-g72072d7dβ-linux-arm/rclone -vvvv --dump-headers --config rclone.conf lsd b2:
2017/11/06 01:52:09 DEBUG : Using config file from "/root/rclone.conf"
2017/11/06 01:52:09 DEBUG : rclone: Version "v1.38-090-g72072d7dβ" starting with parameters ["./rclone-v1.38-090-g72072d7dβ-linux-arm/rclone" "-vvvv" "--dump-headers" "--config" "rclone.conf" "lsd" "b2:"]
2017/11/06 01:52:09 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/11/06 01:52:09 DEBUG : HTTP REQUEST (req 0x11232c80)
2017/11/06 01:52:09 DEBUG : GET /b2api/v1/b2_authorize_account HTTP/1.1
Host: api.backblazeb2.com
User-Agent: rclone/v1.38-090-g72072d7dβ
Authorization: XXXX
Accept-Encoding: gzip

2017/11/06 01:52:09 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

To summarise the following versions hang:

rclone-v1.38 with go1.9
rclone-v1.38-052-gf60e2a7aβ with go1.9.2
rclone-v1.38-090-g72072d7dβ with go1.9.2

While the following versions work:

rclone-v1.38-084-gb27e4ec3 with go1.8.3

I tried to replicate this on my raspberry pi 3 (in 32 bit mode) but I couldn't... What platforms are you using?
I also wrote a quick test program to see if it would replicate the problem.  Attached is a zip with it compiled with go1.8, go1.9 and go-tip - can you try the programs and report back?  If it works it will print something like - what I'm interested in, is if it hangs like rclone.
go version devel +0ba4eba864 Mon Nov 6 08:37:30 2017 +0000
Status: 401: 401 Unauthorized
Body:
{
  "code": "missing_auth_token",
  "message": "Missing authorization token",
  "status": 401
}

b2get.zip
b2get
├── b2get-go-tip      - binary compiled with go tip
├── b2get-go1.8.3   - binary compiled with go1.8
├── b2get-go1.9.2   - binary compiled with go1.9
└── b2get.go           - the source

$ time ./b2get-go-tip
go version devel +0ba4eba864 Mon Nov 6 08:37:30 2017 +0000
^C

real    0m7.447s
user    0m0.020s
sys     0m0.010s
steve@mercury:~/tmp/b2get
$ time ./b2get-go1.9.2
go version go1.9.2
^C

real    0m10.927s
user    0m0.030s
sys     0m0.010s
steve@mercury:~/tmp/b2get
$ time ./b2get-go1.8.3
go version go1.8.3
Status: 401: 401 Unauthorized
Body:
{
  "code": "missing_auth_token",
  "message": "Missing authorization token",
  "status": 401
}
real    0m0.842s
user    0m0.230s
sys     0m0.010s

$ uname -a
Linux mercury 4.5.7-std-4 #1 SMP Tue Jul 12 11:00:06 UTC 2016 armv7l GNU/Linux

$ cat /proc/cpuinfo | head -20
processor       : 0
model name      : ARMv7 Processor rev 2 (v7l)
BogoMIPS        : 50.00
Features        : half thumb fastmult vfp edsp thumbee vfpv3 tls idiva idivt vfpd32 lpae
CPU implementer : 0x56
CPU architecture: 7
CPU variant     : 0x2
CPU part        : 0x584
CPU revision    : 2

...
<snip>
...
Hardware        : Marvell Armada 370/XP (Device Tree)
Revision        : 0000
Serial          :<PHONE_NUMBER>000000

Mine is a scaleway arm server.

Here pretty much the same, also a scaleway arm server.
time ./b2get-go-tip
go version devel +0ba4eba864 Mon Nov 6 08:37:30 2017 +0000
^CCommand terminated by signal 2
real	0m 34.52s
user	0m 0.00s
sys	0m 0.01s

time ./b2get-go1.9.2
go version go1.9.2
^CCommand terminated by signal 2
real	3m 2.82s
user	0m 0.02s
sys	0m 0.00s

time ./b2get-go1.8.3
go version go1.8.3
Status: 401: 401 Unauthorized
Body:
{
  "code": "missing_auth_token",
  "message": "Missing authorization token",
  "status": 401
}real	0m 0.78s
user	0m 0.16s
sys	0m 0.01s

$ uname -a
Linux scw-553c2c 4.4.96-mainline-rev1 #1 SMP Thu Nov 2 11:27:34 UTC 2017 armv7l Linux

$ cat /proc/cpuinfo | head -20
processor	: 0
model name	: ARMv7 Processor rev 2 (v7l)
BogoMIPS	: 50.00
Features	: half thumb fastmult vfp edsp thumbee vfpv3 tls idiva idivt vfpd32 lpae
CPU implementer	: 0x56
CPU architecture: 7
CPU variant	: 0x2
CPU part	: 0x584
CPU revision	: 2

...
<snip>
...

Hardware	: Marvell Armada 370/XP (Device Tree)
Revision	: 0000
Serial		:<PHONE_NUMBER>000000

I've opened a go issue about this: https://github.com/golang/go/issues/22614
If you could help with investigations on that thread I'm sure it would help!  I posted a request for more info there.


Fix for pdf conversion

converting to PDF needs pandoc to be invoked as --to=latex -o something.pdf.
Unfortunately we didn't enforce that:

The old tests for pdf relied on "pdf" is "pdf" tests which is not always
true of one of the strings was not interned.
using the convert(.., to="pdf") was actually doing a conversion to html

The new checks ensure that, if to="pdf":

an outfile of type pdf is also given
the actual invocation of pandoc passes latex as the to format

Fixes #100

@bebraw Could you have a look and merge if satisfied?

I guess the next step might be to get a beta out. 👍


ID Pool for API 200/300 support

Description
Implementation of the id pool for i3s API300 support.
Issues Resolved
Fixes #237
Check List

[x] New functionality includes testing.

[x] All tests pass ($ rake test).

[ ] New functionality has been documented in the README if applicable.

[x] New functionality has been thoroughly documented in the examples (please include helpful comments).

[x] Changes are documented in the CHANGELOG.

@ricardogpsf , I made the changes. Please, check again.


Use extension in multiple dbt projects inside a single devcontainer

Hi, I'm trying to set up a devcontainer in vscode to allow for a reproducible dev environment for our data team. Since we work on more than a single project, the root directory (or workspace) i'm opening contains a number of projects, some of which are dbt projects
See an example of our workspace:
.
|____.devcontainer
|____.vscode
|____airflow-project
|____airflow-project-2
|____infrastructure-project
|____dbt-image
|____dbt-snowflake-1
|____dbt-snowflake-2
|____dbt-snowflake-3
|____dbt-snowflake-4
|____devcontainers
|____python-project

In each of the dbt-snowflake projects we have a .sqlfluff config file that looks more or less like this:
[sqlfluff]
dialect = snowflake
templater = dbt
exclude_rules = L001, L034

[sqlfluff:templater:dbt]
project_dir = ./

[sqlfluff:rules]
max_line_length = 999
tab_space_size = 4
indent_unit = space

[sqlfluff:rules:L010]
# Keywords
capitalisation_policy = lower

[sqlfluff:rules:L030]
# Function names
capitalisation_policy = lower

[sqlfluff:rules:L040]
# Null & Boolean Literals
capitalisation_policy = lower

[sqlfluff:rules:L057]
# Special Characters in Identifiers
allow_space_in_identifier = True
additional_allowed_characters = ['.','(',')','-']

This ensures that in a vacuum sqlfluff works inside each project, but we only get the vscode extension to work on a single project, which is the one for which we configure the  "sqlfluff.config"
In the devcontainer.json we have the following config for sqlfluff (as we see here we configure the config path to be the one inside project 1):
        "sqlfluff.config": "${workspaceFolder}/dbt-snowflake-1/.sqlfluff",
        "sqlfluff.dialect": "snowflake",
        "sqlfluff.executablePath": "/usr/local/bin/sqlfluff",
        "sqlfluff.format.enabled": true,
        "sqlfluff.format.workingDirectory": "",
        "sqlfluff.ignoreLocalConfig": true,
        "sqlfluff.ignoreParsing": false,
        "sqlfluff.linter.run": "onSave",
        "sqlfluff.experimental.format.executeInTerminal": true,
        "editor.formatOnSave": false,
        "[sql]": {
            "editor.defaultFormatter": "dorzey.vscode-sqlfluff"
        }

Now i have a couple of questions:
Is it possible for us to get the extension to work on all projects inside a single devcontainer? Meaning, we want to be able to work on a .sql file inside whichever dbt project and get it linted on save.
On the other hand what is the expected performance for the linting? I feel like it consumes a lot of resources and takes a considerable amount of time, probably because or projects are large and the compilation takes a lot of time. Do subsequent lintings use partial parsing?
Feel free to request more details or give us tips on best practices or how to properly configure such a dev environment/container.
Many thanks.

I think it would be possible to get the extension to work on all projects, but I have not tested this before so I am not sure. Your best bet would be to remove the sqlfluff.config option as you are needing multiple different configs and I don't think there is an easy way for you to look into each folder for the configuration file. I would suggest setting "sqlfluff.workingDirectory" = "${fileDirname}". This sets the directory the sqlfluff command is run from and sqlfluff should recognize those configuration files automatically.
The linting performance is not good, but I do not know how the linting works. I have not done any work in the sqlfluff repository, I just work on this extension. You would have to look at that repository for any performance concerns. This extension basically just runs the sqlfluff command and shows that output in VSCode.
Let me know if you are able to get your project working with my suggestions.

Hi @RobertOstermann , i tried your config proposal:

        //"sqlfluff.config": "${workspaceFolder}/dbt-snowflake/.sqlfluff",
        "sqlfluff.workingDirectory": "${fileDirname}",
        "sqlfluff.dialect": "snowflake",
        "sqlfluff.executablePath": "/usr/local/bin/sqlfluff",
        "sqlfluff.format.enabled": true,
        "sqlfluff.format.workingDirectory": "",
        "sqlfluff.ignoreLocalConfig": true,
        "sqlfluff.ignoreParsing": false,
        "sqlfluff.linter.run": "onSave",
        "sqlfluff.experimental.format.executeInTerminal": true,
        "editor.formatOnSave": false,
        "[sql]": {
            "editor.defaultFormatter": "dorzey.vscode-sqlfluff"

But it failed with the following error (taken out of the output terminal for sqlfluff):
------------------------------------------------------------

Reading from file, not stdin

--------------------Executing Command--------------------

/usr/local/bin/sqlfluff lint --format json --dialect snowflake --ignore-local-config ../../../../../../dbt/dbt-snowflake/models/marts/analytics/dim_class.sql

------------------------------------------------------------

Child process threw error
Error: spawn /usr/local/bin/sqlfluff ENOENT
Linting command failed to execute

Any idea how to solve this?

@ggmblr I think this error occurs whenever the program is unable to find the sqlfluff executable. Though I also would not have expected that file path to be going up directories to find the file.
You should try running the /usr/local/bin/sqlfluff lint --format json --dialect snowflake --ignore-local-config ../../../../../../dbt/dbt-snowflake/models/marts/analytics/dim_class.sql command in the directory that dim_class.sql is located. Essentially this extension just runs that commands in that directory and parses the output to determine where the errors need to be shown in VSCode.
It is possible that you just need to update your sqlfluff.executablePath to match the command you would call to run sqlfluff in the terminal. But if that command works in the terminal then that is not the case.
Did you have this extension working before updating the sqlfluff.workingDirectory?

@RobertOstermann I tried running the command in various directories manually and it didn't work. The error message was always
[{"filepath": "../../../../../../dbt/dbt-snowflake/models/marts/analytics/dim_class.sql", "violations": [{"line_no": 1, "line_pos": 1, "code": "TMP", "description": "Unrecoverable failure in Jinja templating: <sqlfluff.core.templaters.jinja.JinjaTemplater.process.<locals>.UndefinedRecorder object at 0x7ffac1ab1c10> is not safely callable. Have you configured your variables? https://docs.sqlfluff.com/en/latest/configuration.html"}]}]

So i tried removing the sqlfluff.workingDirectory . The executed command and error on save is the following:
--------------------Executing Command--------------------

/usr/local/bin/sqlfluff lint --format json --dialect snowflake --ignore-local-config dbt-snowflake/models/marts/analytics/dim_class.sql

------------------------------------------------------------

Received close event, code 1 signal null
Raw stdout output:

------------------------------------------------------------

[{"filepath": "dbt-snowflake/models/marts/analytics/dim_class.sql", "violations": [{"line_no": 1, "line_pos": 1, "code": "TMP", "description": "Unrecoverable failure in Jinja templating: <sqlfluff.core.templaters.jinja.JinjaTemplater.process.<locals>.UndefinedRecorder object at 0x7f7ecd9674c0> is not safely callable. Have you configured your variables? https://docs.sqlfluff.com/en/latest/configuration.html"}]}]

------------------------------------------------------------

Running the execution command inside the terminal either yields the same error message when run in a parent directory, or
in this error, when running it in the same directory.

With my previous config (which didn't include the  sqlfluff.workingDirectory, but included "sqlfluff.config": "${workspaceFolder}/dbt-snowflake/.sqlfluff" was working fine at least for that specific directory. See here:
--------------------Executing Command--------------------

/usr/local/bin/sqlfluff lint --format json --config /dbt/dbt-snowflake/.sqlfluff --dialect snowflake --ignore-local-config dbt-snowflake/models/marts/analytics/dim_class.sql

------------------------------------------------------------

Received close event, code 1 signal null
Raw stdout output:

------------------------------------------------------------

[{"filepath": "dbt-snowflake/models/marts/analytics/dim_class.sql", "violations": [{"line_no": 27, "line_pos": 1, "code": "L010", "description": "Keywords must be lower case."}]}]

------------------------------------------------------------

My next test is to combine both configs, have sqlfluff.workingDirectory and "sqlfluff.config": "${workspaceFolder}/dbt-snowflake/.sqlfluff".
Here it fails telling me in a pop up error
The sqlfluff executable was not found. Use the 'Executable Path' setting to configure the location of the executable, or add it to your PATH.

While the output is the following:
--------------------Executing Command--------------------

/usr/local/bin/sqlfluff lint --format json --config /dbt/dbt-snowflake/.sqlfluff --dialect snowflake --ignore-local-config ../../../../../../dbt/dbt-snowflake/models/marts/analytics/dim_class.sql

------------------------------------------------------------

Child process threw error
Error: spawn /usr/local/bin/sqlfluff ENOENT
Linting command failed to execute

So what you mention about sqlfluff.executablePath seems to be a good starting point. Which path would i need to provide? /usr/local/bin/sqlfluff?
Thanks again for your help.

@RobertOstermann Using the suggested config with v2.2.3 results in the following output:
------------------------------------------------------------

Reading from file, not stdin

--------------------Executing Command--------------------

/usr/local/bin/sqlfluff lint --format json --dialect snowflake dim_class.sql

------------------------------------------------------------

Received close event, code 1 signal null
Raw stdout output:

------------------------------------------------------------

[{"filepath": "dim_class.sql", "violations": [{"line_no": 1, "line_pos": 1, "code": "TMP", "description": "Unrecoverable failure in Jinja templating: <sqlfluff.core.templaters.jinja.JinjaTemplater.process.<locals>.UndefinedRecorder object at 0x7fceee89e9a0> is not safely callable. Have you configured your variables? https://docs.sqlfluff.com/en/latest/configuration.html"}]}]

------------------------------------------------------------

Which suggests that it is not able to read my config for sqlfluff, which is set with
templater = dbt

Ok, I am about out of ideas. One last thing you could try would be removing the sqlfluff.workingDirectory configuration from the last setup I gave you and hope that SQLFluff can find the correct configuration files on its own. You can look at this page to see how SQLFluff finds configuration files - Configuration.
"sqlfluff.dialect": "snowflake",
"sqlfluff.executablePath": "/usr/local/bin/sqlfluff",
"sqlfluff.format.enabled": true,
"sqlfluff.ignoreLocalConfig": false,
"sqlfluff.ignoreParsing": false,
"sqlfluff.linter.run": "onSave",
"sqlfluff.experimental.format.executeInTerminal": true,
"editor.formatOnSave": false,
"[sql]": {
    "editor.defaultFormatter": "dorzey.vscode-sqlfluff"
}

If that doesn't work you would have to find some consistent way of calling SQLFluff from the terminal that works for your different cases. This extension is fairly configurable so if you are able to find something that works I don't think it would be too difficult to set up with the available settings.


[8] Display tree based on data structure representation

Parse nodes:
call api, display api as a tree
api tell you which one is a golden node and can use digraph color changer to be able to change node to gold.

From Kulsoom on Discord:  - need to figure out page routing from React page to react page router file to Django URL

@kulriz and @MaksimEkin assisted in completing this story.


Crash (on Server)

Personal modpack, crash when crafting anything
Here is the report (using NotEnoughCrashes)
https://controlc.com/fd40ece9

Looks like a bug in netherite plus.  I have no idea how they'd have a recipe where canFit is abstract tho


Create diagrams for auth flows, now and future

Is your feature request related to a problem? Please describe.
We need diagrams which clearly explain authentication flows - now and future
Describe the solution you'd like
Diagrams in this repo to explain authentication flows, now and future (https://github.com/atsign-foundation/at_protocol/blob/trunk/decisions/2023-01-pkam-per-app-and-device.md)
Describe alternatives you've considered
No response
Additional context
No response

Have done the diagrams, need to create a PR and get it reviewed

Closed by https://github.com/atsign-foundation/at_protocol/pull/66


Update grafana to v8.0.2

8.0.2 (2021-06-14)

@sakkiii did it upgrade smoothly without loosing any existing  or imported dashboard and configuration ?


pack cli with cloudfoundry/cnb:cflinuxfs3 on windows = permission denied

I followed this tutorial, and got a choice of 3 buildpacks from pack:

cloudfoundry/cnb:bionic
cloudfoundry/cnb:cflinuxfs3
heroku/buildpacks

At first I picked number 2, but after running pack build myapp it ends with this error. Then I set the default builder to 3, ran the command again, and it finished:
Status: Downloaded newer image for cfbuildpacks/cflinuxfs3-cnb-experimental:run
Using build cache image pack-cache-40a311b545d7
Warning: lifecycle version unknown
===> DETECTING
[detector] Trying group of 8...
[detector] ======== Results ========
[detector] Cloud Foundry OpenJDK Buildpack: pass
[detector] Cloud Foundry Build System Buildpack: pass
[detector] Cloud Foundry JVM Application Buildpack: pass
[detector] Cloud Foundry Azure Application Insights Buildpack: skip
[detector] Cloud Foundry Debug Buildpack: skip
[detector] Cloud Foundry Google Stackdriver Buildpack: skip
[detector] Cloud Foundry JMX Buildpack: skip
[detector] Cloud Foundry Procfile Buildpack: skip
===> RESTORING
[restorer] cache image 'pack-cache-40a311b545d7' not found, nothing to restore
===> ANALYZING
[analyzer] WARNING: image 'index.docker.io/library/myapp:latest' not found or requires authentication to access
[analyzer] WARNING: image 'index.docker.io/library/myapp:latest' has incompatible 'io.buildpacks.lifecycle.metadata' label
===> BUILDING
[builder] -----> Cloud Foundry OpenJDK Buildpack 1.0.0-M6
[builder] -----> OpenJDK JDK 11.0.2: Contributing to layer
[builder]        Downloading from https://java-buildpack.cloudfoundry.org/openjdk-jdk/bionic/x86_64/openjdk-11.0.2_09.tar.gz
[builder]        Verifying checksum
[builder]        Expanding to /layers/org.cloudfoundry.openjdk/openjdk-jdk
[builder]        Writing JAVA_HOME to build
[builder]        Writing JDK_HOME to build
[builder] -----> OpenJDK JRE 11.0.2: Contributing to layer
[builder]        Downloading from https://java-buildpack.cloudfoundry.org/openjdk/bionic/x86_64/openjdk-11.0.2_09.tar.gz
[builder]        Verifying checksum
[builder]        Expanding to /layers/org.cloudfoundry.openjdk/openjdk-jre
[builder]        Writing JAVA_HOME to shared
[builder]
[builder] -----> Cloud Foundry Build System Buildpack 1.0.0-M6
[builder] -----> Using wrapper
[builder]        Linking Cache to /home/vcap/.m2
[builder] -----> Compiled Application: Contributing to layer
[builder] fork/exec /workspace/mvnw: permission denied
[builder] Error: failed to : exit status 103

ERROR: failed with status code: 7

@JJWTimmer What version of pack are you using?

v0.2.0, just downloaded it

@JJWTimmer So just reading your issue, you got the error with cloudfoundry/cnb:cflinuxfs3, not heroku/buildpacks, when you were using windows? I just ran the sample app with  cloudfoundry/cnb:cflinuxfs3 with pack version 0.2.0 and it works on OSX.

Yip! I didn't try buildpack 1) only 2) and 3) and only 2) failed. Indeed on Windows 10 with Docker Desktop on Hyper V.

Hi @JJWTimmer, thanks for bringing this up. We're actually already working on this issue over in the pack CLI.
@chhhavi Feel free to close this issue and we'll track it over in the pack repo