Create ETL functions for stored EIA API fuel price data

Once we have programmatic access to the EIA API data via the PUDL Datastore, we can integrate it into the overall database / ETL process:

[ ] Extract function should probably return the JSON object that's being stored in the archive, which is hopefully the same thing you'd get back from the API itself with an appropriate query, so that one can do development using the live API before having a working archive.
[ ] Transform function should turn that JSON into one or more well normalized dataframes with fuel price per MMBTU and fuel quantity in MMBTU as the data columns, and primary key columns corresponding to the various aggregation dimensions (time period, geographic area, fuel type code, industrial sector).
[ ] Load the new table (or tables) into the PUDL SQLite DB so it can be used in a variety of contexts. This will mean defining any new columns as fields in the Pydantic metadata classes, creating Resource definitions, and adding the ETL to the top level PUDL ETL function.

I've finally added the EIA Bulk Electricity data to the datastore. It's called eia_bulk_elec. I had imagined something like this would work, but apparently in addition to being 680,434 lines long, the JSON data isn't actually stored in a JSON file but rather as one independent JSON object per line. So I guess some kind of line by-line iteration / generator makes sense?
import zipfile
import json

import pudl

pudl_settings = pudl.workspace.setup.get_defaults()
ds = Datastore(local_cache_path=pudl_settings["data_dir"])

with ds.get_zipfile_resource("eia_bulk_elec").open("ELEC.txt", "r") as z:
    elec_json = json.loads(z.read().decode("utf-8"))


Importing dppl fails when no CPU OpenCL driver is found on the system

Importing dppl should not fail if a GPU OpenCL driver exists but no CPU driver is found.

@reazulhoque Can you please investigate this issue? It may have gotten fixed in all the recent changes we have made to dppl. The issue is to cleanly handle the case when someone tried import dppl but the system has either no OpenCL/Level-0 drivers or it only has a GPU driver and no CPU driver.

@PokhodenkoSA This one may already be fixed. If I recall correctly the issue was thet module will not load if no CPU device existed. But, we have been running without issue on CI where there is no CPU present.
Can be closed?

Correct. Can be closed.


45410912 - Portal 2

Validation

[X] I've read the FAQ.
[X] The Xenia build used is from a canary branch. (not MLBS/AlexVS/master/pull requests, etc)
[X] This issue isn't for help (tech support) with Xenia, or a game.
[X] I've checked if this game doesn't already have a compatibility report.

Xbox 360 Marketplace link
https://marketplace.xbox.com/en-US/Product/Portal-2/66acd000-77fe-1000-9115-d80245410912
Xenia version
https://github.com/xenia-canary/xenia-canary/commit/1319ff6ead3c7d43af63b87be8c3ba486c8e53b5/
Issues
Menus do not appear. Game is playable otherwise.
Log
xenia-log.zip
Screenshots

Labels
state-gameplay gpu-drawing-corrupt gpu-drawing-missing tech-engine-source

Nvm. I was able to fix game by setting d3d12_readback_resolve = true.


ReadTimeoutError

Any chance to increase the timeout?  Got the following timeout on initial index loading with settings configuration.
Thanks
raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % timeout_value)
urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='<IP_ADDRESS>', port=9200): Read timed out. (read timeout=10)

@lianyi Added a new flag for ESL, --timeout let me know if you still have issues.

Thanks!
On Sun, Aug 12, 2018 at 11:41 AM Moshe Zada<EMAIL_ADDRESS>wrote:

@lianyi https://github.com/lianyi Added a new flag for ESL, --timeout
let me know if you still have issues.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/moshe/elasticsearch_loader/issues/37#issuecomment-412363235,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AICm49qRty7UmZdmv8nRqnoc_4ydxhRrks5uQHbygaJpZM4V5OrI
.


Custom tags for wasm release builds

Feel free to adjust tags as needed. Just note that cross platform Go builds are not possible to do for features requiring C bindings (CGO). There are workarounds, but likely not needed: https://goreleaser.com/cookbooks/cgo-and-crosscompiling/

Thank you again for PR and explanation in the previous one! I will test it in the evening and try to create a release.


question about a filling problem

Hello, first of all thank you for your wonderful parser.
I'm trying to load an DXF file into an svg (which just contains a circle), which works nice after some adjustments:

Im using the toPolylines() method and iterate over all polylines.
My Problem is filling the inner of the Path. If i group all lines in a g-tag and do fill="white" it looks like that:

When I put all polyline in a single Path/Polyline (and fill white)  i get:

Do you have any ideas to fill the inner?
Thank you for your help.

For SVG you would have to make a single path from the polylines, but the order is important. So I think for your single path they are not in the correct order?
I think you would have to write an algorithm that starts with one polyline, then matches the last point of that polyline to the first point of the correct polyline, and repeat until it's complete.

Aaah the polylines are not in the right order - that explains everything. Thank you for the tip. After reordering it looks quite good:

Somehow it cut oout/extended the white parts from the second image - the 'arky' parts...Now it looks a bit edgy... Do you have an idea for that problem too?
Thank you

Looks like you algorithm removed some of the points? If you renmove the fill you should be able to check just the path

I got it working, my algorithm was not working right. The points are not matching exact, now i take the nearest point.

For interested my algorithm is:

    const helper = new Helper(dxf)
    let polylines = helper.toPolylines().polylines.map(pl => pl.vertices)
    let firstpoly = polylines.splice(0,1)
    let output = firstpoly[0]
    while (polylines.length > 0) {
        let lastpoint = output[output.length-1]
        //   Sort polylines by distance of their first points to lastpoint
        polylines = polylines.sort( (a,b) => {
                const adistance = pointDistance(a[0],lastpoint)
                const bdistance = pointDistance(b[0],lastpoint)
                return adistance - bdistance
            })
        output = output.concat(polylines[0])
        polylines.shift()
    }
    return output.map(v => `${v[0]},${v[1]}` ).join(' ')

where pointDistance is a function which calculates the distance between 2 points

Nice :)


en-us time format uses 24 hrs and am/pm

I think the time format for en-us and en-gb should be the same.
Currently en-us formats the time with 24 hrs plus am/pm additionally which is redundant.

I hope to allocate time to look at this soon.

To make it easier for you I created a pull request so this issue can be closed.


Change basal rounding to match values the pump can deliver

I think rounding is different for x23's

Do you know what the minimum scroll rate is for an x23?

For the bolus wizard it's configurable, I forget what the basal steps are,
but I know they are smaller for x23's.
On Jun 14, 2016 4:05 PM, "Chris Oattes"<EMAIL_ADDRESS>wrote:

Do you know what the minimum scroll rate is for an x23?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/openaps/oref0/pull/131#issuecomment-225999704, or mute
the thread
https://github.com/notifications/unsubscribe/AAt2JxAIlm1xiIN6J5jZ7RoB_YLhsURdks5qLwmJgaJpZM4I1s65
.

The problem with waiting until the last minute to round things is you get lost of really ugly 17-digit numbers being reported in the UI.  I like the change in the PR, and am happy to merge it as soon as we verify the basal resolution of the x23s.  @loudnate may know offhand, or we can go find where he does the same thing in his code.

eww, it actually turns out to be nasty. I thought it was the same as the bolus scroll rate, it turns out it is dependent on how large the basal rate is:
Increments:
• 0.025 units for basal amounts in the range of 0.025 to 0.975 units
• 0.05 units for basal amounts in the range of 1 to 9.95 units
• 0.1 units for basal amounts of 10.0 units or larger
For both the x23 (https://www.medtronicdiabetes.com/sites/default/files/library/download-library/user-guides/Paradigm_Revel_user_guide.pdf) and x54 (https://www.medtronic-diabetes.co.uk/sites/uk/medtronic-diabetes.co.uk/files/veo-x54_ifu_updated_26.04.2013.pdf)

So looks like 1/40 (0.025) will work, right?  If we're >= 1U/hr the pump will further round it to 1/20 (which it's already doing today).  Any reason we can't just let it keep doing that?  When the basal rate is that high, a slight mismatch between requested and enacted is no big deal: we just observe what was actually delivered and incorporate that into IOB.

I think a scale factor of 40 is better than what is there at the moment. I could just write a function to do the correct rounding (for x23 and x54 at least)


Configure LDAP authentication by environment variables?

Hello,
Question:
Is it possible to setup LDAP authentication by environment variables or by start parameters in a docker-compose file before starting the container?

Hi there,
This is not currently a feature of Portainer, however there is a feature request already for this feature here: #3125
Closing as duplicate


Download fail

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm reporting that yt-dlp is broken on a supported site
[X] I've verified that I have updated yt-dlp to nightly or master (update instructions)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[ ] I've read about sharing account credentials and I'm willing to share it if required

Region
Malaysia
Provide a description that is worded well enough to be understood
App version: 1.11.1 (11112)
Device information: Android 13 (API 33)
Supported ABIs: [arm64-v8a, armeabi-v7a, armeabi]
Yt-dlp version: 2023.11.16
URL:
WARNING: [TikTok]<PHONE_NUMBER>670189825: Unable to find video in feed; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U; trying with webpage
ERROR: [TikTok]<PHONE_NUMBER>670189825: Unable to extract sigi state; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[X] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
Im. Not a coder but just here to report the issue

Im. Not a coder but just here to report the issue

Im not a mindreader. Need users to follow the instructions


[Unit Test] Use matrix build workflow, remove 3rd party dependency

What is the purpose of the change

Use matrix build workflow
remove 3rd party step dependency due to apache limit

Codecov Report

Merging #7078 (808ee58) into master (70b6fb3) will decrease coverage by 1.12%.
The diff coverage is n/a.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 70b6fb3...808ee58. Read the comment docs.

Codecov Report

Merging #7078 (808ee58) into master (70b6fb3) will decrease coverage by 1.12%.
The diff coverage is n/a.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 70b6fb3...808ee58. Read the comment docs.


Upgrade CRI to proto3

CRI has changed its API to proto3. We should upgrade our vendor.

I will take this task


Avoid scrolling into view a sidebar element when labeling it

What is the current behavior?
Labeling an element on the sidebar panel scrolls that element into view. This is not the expected behaviour.
What is the expected behavior?
Clicking a sidebar element is expected to scroll that element into view but labeling it should't.

Fixed by https://github.com/label-sleuth/label-sleuth/pull/312.


Found plugins with same names and architectures

Found plugins with same names and architectures, Assets/Plugins/x64/sqlite3.dll () and Assets/Plugins/x86/sqlite3.dll (). Assign different architectures or delete the duplicate.
UnityEditor.AndroidPluginImporterExtension:CheckFileCollisions(String)
UnityEditorInternal.PluginsHelper:CheckFileCollisions(BuildTarget) (at C:/buildslave/unity/build/Editor/Mono/Plugins/PluginsHelper.cs:25)
UnityEditor.BuildPlayerWindow:BuildPlayerAndRun()
Plugins colliding with each other.
Build completed with a result of 'Failed'
UnityEditor.BuildPlayerWindow:BuildPlayerAndRun()
UnityEditor.BuildPlayerWindow+BuildMethodException: 2 errors
at UnityEditor.BuildPlayerWindow+DefaultBuildMethods.BuildPlayer (BuildPlayerOptions options) [0x0020e] in C:\buildslave\unity\build\Editor\Mono\BuildPlayerWindowBuildMethods.cs:181
at UnityEditor.BuildPlayerWindow.CallBuildMethods (Boolean askForBuildLocation, BuildOptions defaultBuildOptions) [0x00065] in C:\buildslave\unity\build\Editor\Mono\BuildPlayerWindowBuildMethods.cs:88
UnityEditor.BuildPlayerWindow:BuildPlayerAndRun()
I create a new project, There are no extra files in it.
how can i fixed it?

I tried change Api Compatibility Level of the player setting to .NET 2.0.
But it still doesn't work.

Make your x86 dll to CPU Architecture 'x86'
Make your x64 dll to CPU Architecture 'Armv7'
At the moment they will both be the same.

You need to put the whole folder in plugins, solved this for me

this is the best source for android64 sqlite I've found yet.
https://github.com/robertohuertasm/SQLite4Unity3d/blob/master/Example/Assets/Plugins/Android/libs/arm64-v8a/libsqlite3.so


[pt-br] Add /docs/reference/setup-tools

Add directory:

content/pt-br/docs/reference/setup-tools/
content/pt-br/docs/reference/setup-tools/kubeadm

Add files:

content/pt-br/docs/reference/setup-tools/_index.md
content/pt-br/docs/reference/setup-tools/kubeadm/_index.md

/assign @yagonobre

/assign @stormqueen1990

/hold
Until #33112, #33113, #33114, #33115, #33116, and #33117 are merged, so we can update the index links accordingly.

/hold
Until #33112, #33113, #33114, #33115, #33116, and #33117 are merged, so we can update the index links accordingly.

These PR are broken links on whatsnext. When are we going to fix these files?

These PR are broken links on whatsnext. When are we going to fix these files?

Those PRs created the missing files, correct? When they get merged, you will be able to rebase this branch and fix the links.

/approve
Once the files are fixed, @stormqueen1990 feel free to lgtm
I've just approved the other ones!
Thank you both for the hard work here!

Hello @stormqueen1990 , could you please have a look at this PR and provide your LGTM whenever everything's okay per expectations?

Hi there, @divya-mohan0209!
Sure thing, will do! It will be blocked a little bit longer though as we are still missing the translations for kubeadm init and join.

/remove-lifecycle stale

/hold

/lifecycle frozen

Hello @stormqueen1990 , good day! Please don't consider this me imposing or overstepping on your localization efforts. However, it seems that this PR has been pending merge due to localization efforts for other pages that have currently been merged. Please could you advise if this one can now be reviewed/approve appropriately?

Hello @stormqueen1990 , good day! Please don't consider this me imposing or overstepping on your localization efforts. However, it seems that this PR has been pending merge due to localization efforts for other pages that have currently been merged. Please could you advise if this one can now be reviewed/approve appropriately?

Hi there, @divya-mohan0209! We're almost ready to merge this one. The last related PR is #38625, which is well on its way.

/unhold
/lgtm
/label tide/merge-method-squash
Thank you very much @MrErlison! 🎉


Simplify 404

The extra features in 404 caused some issues.  Decided to remove instead of fix.

Do you remember what issue was caused?
I see some value in displaying some content on the 404

Cannot remember the issue - sorry about that.  I was not that experienced with Hugo back then so might have been something I was doing wrong.  Maybe include or exclude it with a flag.


Create the service worker with a helper library instead of manually

You could use:

https://github.com/mozilla/oghliner
https://github.com/delapuente/offliner
https://github.com/GoogleChrome/sw-precache
https://github.com/gaia-components/serviceworkerware
https://github.com/GoogleChrome/sw-toolbox

I or @mykmelez could help if you want to use oghliner.
CCing @delapuente which might help with offliner or serviceworkerware.

@marco-c I am currently working on this using https://github.com/GoogleChrome/sw-toolbox as I think the built in [handlers] (https://github.com/GoogleChrome/sw-toolbox#built-in-handlers) could be useful to developers.


ManageDataOp fails v10 (Docker only, not in testnet).

This XDR TxnEnvelope is the master account writing data hello=world to itself with sequence 1.
AAAAAHN2/eiOTNYcwPspSheGs/HQYfXy8cpXRl+qkyIRuUbWAAAAZAAAAAAAAAABAAAAAAAAAAAAAAABAAAAAAAAAAoAAAAFaGVsbG8AAAAAAAABAAAABXdvcmxkAAAAAAAAAAAAAAERuUbWAAAAQFniHMCm0SWcGMeRfVKadSkn7/7YI6lArME3glPGfJCLPejXskFIV7pBrJ7KdFBE4gIlUahP1OQ5Pm/EI5woQww=

The response is AAAAAAAAAGT/////AAAAAQAAAAAAAAAK/////wAAAAA= (manageDataNotSupportedYet).
Have I missed some essential config? Or is this operation broken for the docker image?

Tested against Dockerfile.testing standalone mode.

Are you using standalone network? If so it's really: https://github.com/stellar/docker-stellar-core-horizon/issues/56. You need to manually run protocol upgrades using /upgrades endpoint in code. If you don't know how to do it please wait for a fix or use testnet.


azure filer.backup fails to write data with 412 response codes.

https://github.com/seaweedfs/seaweedfs/blob/c96b2ce8e55e84fe46219886f15deb186653c39a/weed/command/scaffold/replication.toml#L59
Yeh, no it doesn't work ;) Well almost, Azure is giving back 412 responses. It looks like the file entries get made but the data within cannot be populated.
Production logs from weed 3.72;
   --------------------------------------------------------------------------------
   RESPONSE Status: 412 The condition specified using HTTP conditional header(s) is not met.
   Content-Length: [252]
   Content-Type: [application/xml]
   Date: [Sun, 15 Sep 2024 22:06:36 GMT]
   Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
   X-Ms-Client-Request-Id: [868de1d9-6c19-487b-7b30-f89816469d4e]
   X-Ms-Error-Code: [ConditionNotMet]
   X-Ms-Request-Id: [65107d29-601e-001c-2abb-07bca4000000]
   X-Ms-Version: [2020-10-02]
E0915 22:06:44.640399 filer_pb_tail.go:97 process directory:"/buckets/raw-data" event_notification:{new_entry:{name:"1.csv" chunks:{file_id:"16,072027ea08" size:8275 modified_ts_ns:1664965018128759939 e_tag:"4yXwW9YYAp7pbo5grF0UiA==" fid:{volume_id:16 file_key:7 cookie:539486728} cipher_key:"r\xf9\x01\xd8J\x9ah I%\xd8\u0097lV&\x83\xec\x9a-\x95h\xce7vS\xa9\xcf^\xf1\x0f\x82"} attributes:{file_size:8275 mtime:1664965018 file_mode:432 uid:1001 gid:1001 crtime:1664965018 mime:"text/csv" md5:"\x06s\xf8\xe0VK\xb8v$\xf9\x8c\x8e\xa60\xcf\xc5"}} delete_chunks:true new_parent_path:"/buckets/raw-data" signatures:1512574186} ts_ns:1664965018132500784: create entry1 : -> github.com/Azure/azure-storage-blob-go/azblob.newStorageError, /go/pkg/mod/github.com/!azure/azure-storage-blob-go@v0.15.0/azblob/zc_storage_error.go:42
===== RESPONSE ERROR (ServiceCode=ConditionNotMet) =====
Description=The condition specified using HTTP conditional header(s) is not met.
RequestId:65108fd6-601e-001c-08bb-07bca4000000
Time:2024-09-15T22:06:44.6324902Z, Details:
   Code: ConditionNotMet
   PUT https://REDACTED.blob.core.windows.net/REDACTED/raw-data/1.csv?timeout=61
   Authorization: REDACTED
   Content-Length: [0]
   If-Unmodified-Since: [Wed, 05 Oct 2022 10:16:58 GMT]
   User-Agent: [Azure-Storage/0.15 (go1.23.0; linux)]
   X-Ms-Blob-Cache-Control: []
   X-Ms-Blob-Content-Disposition: []
   X-Ms-Blob-Content-Encoding: []
   X-Ms-Blob-Content-Language: []
   X-Ms-Blob-Content-Type: []
   X-Ms-Blob-Type: [AppendBlob]
   X-Ms-Client-Request-Id: [43ee4bc9-9af8-4d6a-6011-7fa036103e84]
   X-Ms-Date: [Sun, 15 Sep 2024 22:06:44 GMT]
   X-Ms-Version: [2020-10-02]

So this job made 0-byte files on the azure side then filled weed logs with the above.
Test logs;
E0924 13:16:36.818623 filer_pb_tail.go:97 process directory:"/aztest" event_notification:{new_entry:{name:"10214.txt" chunks:{file_id:"3,079384bf61" size:6 modified_ts_ns:1727183457352227119 e_tag:"leWaAqoHG9I/vm6l76YVmA==" fid:{volume_id:3 file_key:7 cookie:2474950497} is_compressed:true} attributes:{file_size:6 mtime:1727183457 file_mode:438 uid:1000 gid:1000 crtime:1727183457 mime:"text/plain; charset=utf-8"}} delete_chunks:true new_parent_path:"/aztest" signatures:-497442966} ts_ns:1727183457352965205: create entry1 : -> github.com/Azure/azure-storage-blob-go/azblob.newStorageError, /go/pkg/mod/github.com/!azure/azure-storage-blob-go@v0.15.0/azblob/zc_storage_error.go:42
===== RESPONSE ERROR (ServiceCode=ConditionNotMet) =====
Description=The condition specified using HTTP conditional header(s) is not met.
RequestId:21a6b1be-e01e-0060-4483-0e925b000000
Time:2024-09-24T13:16:36.8342054Z, Details:
   Code: ConditionNotMet
   PUT https://redacted.blob.core.windows.net/redacted/debug/aztest/10214.txt?timeout=61
   Authorization: REDACTED
   Content-Length: [0]
   If-Unmodified-Since: [Tue, 24 Sep 2024 13:10:57 GMT]
   User-Agent: [Azure-Storage/0.15 (go1.23.1; linux)]
   X-Ms-Blob-Cache-Control: []
   X-Ms-Blob-Content-Disposition: []
   X-Ms-Blob-Content-Encoding: []
   X-Ms-Blob-Content-Language: []
   X-Ms-Blob-Content-Type: []
   X-Ms-Blob-Type: [AppendBlob]
   X-Ms-Client-Request-Id: [8261a61a-d770-47be-5ec2-5ca5e0b31bf9]
   X-Ms-Date: [Tue, 24 Sep 2024 13:16:36 GMT]
   X-Ms-Version: [2020-10-02]
   --------------------------------------------------------------------------------
   RESPONSE Status: 412 The condition specified using HTTP conditional header(s) is not met.
   Content-Length: [252]
   Content-Type: [application/xml]
   Date: [Tue, 24 Sep 2024 13:16:36 GMT]
   Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
   X-Ms-Client-Request-Id: [8261a61a-d770-47be-5ec2-5ca5e0b31bf9]
   X-Ms-Error-Code: [ConditionNotMet]
   X-Ms-Request-Id: [21a6b1be-e01e-0060-4483-0e925b000000]
   X-Ms-Version: [2020-10-02]

/workspaces/seaweedfs/weed/test (master) $ weed version
version 30GB 3.73  linux amd64

Interestingly, I made 100 text files with random number, these then got uploaded to azure. Upon re-running that copy job, I get the above 412 errors. If I keep re-running filer.backup at difference paths, I make all the test files as well as 412 errors printed.
[sink.azure]
# experimental, let me know if it works
enabled = true
account_name = "REDACTED"
account_key = "REDACTED"
container = "test-mirror"      # an existing container
directory = "/debug/"                # destination directory
is_incremental = false

I made the last test from github@master just now. It's almost certainly related to #5234 maybe another reason to update the azure package?
As an aside, Is it possible to have multiple pairs of sink jobs? From what I can tell of the code we only match one enabled sink.

No Azure account to test it this.
Mostly the bug is around https://github.com/seaweedfs/seaweedfs/blob/master/weed/replication/sink/azuresink/azure_sink.go#L119


Color transformation issue when rendering to viewports

Godot 3.0.2 + Windows 10
When rendering a solid color image to a viewport, the final image will produce a different color to the same image being rendered outside of the viewport.

Consider this node structure:
root
--imageA
--viewportTexture
--viewport
----imageB

imageA and imageB are solid color #090800 quads, both rendered sampling the color from a texture in the shader, using the engine default force_srgb option code:
mix(pow((color + vec3(0.055)) * (1.0 / (1.0 + 0.055)),vec3(2.4)),color * (1.0 / 12.92),lessThan(color,vec3(0.04045)));

imageA renders to screen as the original #090800, whereas imageB renders as #0d0d00, making them slightly off, and thus non-indentical, even though they should be.

I guess this implies that the transformation code is not accurate and when applied twice (when rendering to viewport + rendering to screen) distorts the source color. This happens both with a custom shader and a default spatialMaterial with the force srgb setting.
If not fixes, quick hacks to fix this appreciated.

Edit: The issue appears to be reading the viewport texture color, which produces the incorrect value.
Edit2: Tried using the keep_3d_linear flag mentioned in #19375, available in the 3.1 nightlies, but the result remains unchanged, the read, and in turn rendered, color remains the wrong one.

Almost 2 years later and I'm still getting this bug.

@LandonPowell Please upload a minimal reproduction project to make this easier to troubleshoot.

Can anyone still reproduce this bug in Godot 3.2.3 or any later release?
If yes, please ensure that an up-to-date Minimal Reproduction Project (MRP) is included in this report (a MRP is a zipped Godot project with the minimal elements necessary to reliably trigger the bug). You can upload ZIP files in an issue comment with a drag and drop.

Hi everyone,
I've improved my setup to make things more obvious :

All 3 quads are rendered unshaded and I set their ALBEDO (no mode NORMALMAP stuff like in my previous trial above). I start with a 0.5 gray color, and before setting ALBEDO I transform the gray with smoothstep(0.4992, 0.5008, color); to make slight differences really obvious around 0.5.
The 0.5 gray is generated the following ways depending on the quad :
The leftmost quad gray is hardcoded from vec3(0.5);
The middle quad gray is read from a ViewportTexture rendered in 2D mode
The rightmost quad gray is read from an ImageTexture loaded from a png
As you can see, the leftmost render is OK, middle seems to suffer a slight shift of the 3 components towards 0.0, and rightmost seems to suffer a slight shift as well but in different amounts for RB in one side and G in the other side.
@Calinou and @KoBeWi : is that clear enough ?
Here is the new MRP : Godot_issue_20069_new.zip

@Flarkk Which OS are you on? A green viewport has been reported on macOS, but not on other operating systems.

Hey @Calinou, I'm on Ubuntu.
But there is nothing to do here with the green screen problem you mention.
The green is just an ultra-emphasized proof of the fact that the 3 shaders on the 3 patches work slightly differently :
As said above, the input being a 0.5 gray color, depending on where it comes from (vec3(0.5) in the shader, ViewportTexture, ImageTexture), the output ALBEDO is a slightly different gray.
To make this sligh difference more obvious, I've applied a tight smoothstep around 0.5 (typically smoothstep(0.4992, 0.5008, color);)
The result happens to be green on the right and dark gray on the middle, although it should be light gray as the leftmost one. This denotes the RGB components are slightly alterated around 0.5.
As a double-check, in the MRP above you can try to remove the smoothstep(); in the 3 shaders, and you'll notice all 3 patches look very similarly gray (although the grays are actually slighlty different).

Still valid in 4.2.dev (ba54c3455) five years later, here is a super simple reproduction project:
issue-20069.zip
It's just a SubViewport with a ColorRect:
func _ready() -> void:
	await RenderingServer.frame_post_draw
	print($ColorRect.color)
	print(get_texture().get_image().get_pixel(10,10))

Prints:
(0.5, 0.5, 0.5, 1)
(0.502, 0.502, 0.502, 1)

System info:
Godot v4.2.dev (ba54c3455) - Arch Linux #1 SMP PREEMPT_DYNAMIC Sat, 23 Sep 2023 22:55:13 +0000 - Wayland - Vulkan (Forward+) - dedicated AMD Radeon RX 6600 (amdgpu) - 11th Gen Intel(R) Core(TM) i5-11400 @ 2.60GHz (12 Threads)

Hi Jummit I stumbled across this playing with viewports rendered to 3d objects myself for portals, and realized upon rendering colors are converted from linear to SRGB. My solution was to set the environment on the camera which is rendering to use the linear setting under the tonemap setting. So this way the tonemap is not applied twice and renders correctly in the final shader.
I tried that on your scene but it didn't seem to work setting it on the viewport. I read this conversion does not happen in 2D. If you wrap your ColorRect in a control node it outputs the correct value:

I've created a new issue tracking this, as it may be completely unrelated: #85743


Add the ability to self-define growing environment.

As a user, I don't want to be limited by the things that OpenFarm has predefined in the "environment" categories.

Since these values are stored in the database as an array of strings, the user should be able to switch to a free-form input field - which suggests things for that relevant field - but they should be able to enter anything they want.
We should also allow them to select hydroponic somehow, and then define liquid medium. I know very little about hydroponics so I would love some input into what that looks like. Maybe this gets broken out into its own ticket?

Will the user-defined environments be reviewed by OpenFarm moderators?

I don't think so. @roryaronson, what do you think?
This doesn't mean changing the detail options which store our defaults - we'll still have control of those and those will still define the environment variables that get shown to the user. This would just be letting the user add a random string instead of one of our predefined ones.
What I imagine being useful in the future is for a) lookahead typing so that users will get suggestions from what other users have filled, and b) an ability for admin to see the most popular inputs from users here so that they can add them to the defaults.

That all sounds great ^
Thanks for helping out @gargi-gupta !!


Autoformat entire codebase?

There are two popular ways of applying and enforcing automatic source code formatting a codebase like yours, these are:

clang-format (e.g., for your C++ and protobuf files)
black (for your Python and Jupyter Notebook files)

Which is as easy as:
$ python -m black .
$ fd -eh -ec -ehpp -ecpp -eproto -x clang-format -i --style=Google {} \;

Review changes:

https://github.com/offscale/tensorflow/tree/clang-format-apply from clang-format 13.0.0 at 9ebfeab
https://github.com/offscale/tensorflow/tree/black from python -m black 21.12b0 also at 9ebfeab

Related:

https://github.com/tensorflow/addons does a bunch of auto format and auto linting
My recently merged PR: #53329

Disadvantages:

Impact just about every file in the codebase
Require open PRs to be modified and forks to be updated

Mitigation of disadvantages:

To avoid stepping on toes, one can write a pull request scanner to avoid touching any file that has a current pull request lodged against it. I'm happy to write this script, but will also need someone to run this internally so it knows what files are being affected by non public PRs

Advantages:

Easier for automated tooling to make automated fixes (whitespace / prettyprinting issues don't get in the way)
More consistent codebase (which is somewhat of a quality metric)

@SamuelMarks ,
Please feel free to submit a PR for the requested change or share the link where requested change is to be made in respective repo.Thanks!

See my comment on the PR.
We have internal systems for this, and generally we only apply autoformatting to code when we're updating it for other reasons.
Formatting just to format makes code history harder to follow.

@MarkDaoust Yeah I agree formatting makes code history harder to follow. Which is why generally all these niceties (autolinters, autoformatters, &etc.) are done at the beginning of a project (and not 6 years later).
Still though, I wanted to start the discussion and see if there was any appetite for such.
Naturally autoformatters greatly simplify automated code modification tooling, and the consistency aids in readability/grokking.

Yeah, we have them. Some as presubmit checks in github, some as internal presubmits. But typically we don't apply them to existing code unless it's something we're touching for other reasons.


Tags and Categories disappear for already published posts

Hi,
Tags and Categories disappear for already published posts while making changes to the Articulate (i.e. moving Articulate into another node, or making it a root node).

Is this due to the small amount of caching that occurs for categories/tags? Does it still do this if you have compilation debug="true in your web.config ?

just seen that my issue post https://github.com/Shazwazza/Articulate/issues/268 is a duplicate of this. Yes, I have debug=true in my web.config and the issue is still there.

closing as duplicate of #268


Front page app description

Write an introduction that describes the function of the JobHopper application.  The source of the data and its limitations will be included as well. If we have any governance information that might be included or it might be separate.

Here are initial designs based on an 1152 x 700 laptop display. The site vocabulary needs to be established, for instance, when to use occupations versus jobs? I have tried to keep the language neutral in my mock-up.
JobHopper Design. 2020 10.pdf

Moving this to In Review. @alexjball , do you want to take a pass at this and add any issues in as needed to do this UI work?

Annie created a first draft text document, it contains text for several pages, and points to new text for FAQ. https://cfb-public.slack.com/files/U3C6CMSVC/F01E5FH2N6L/jobhopper_site_text

Closing this issue since there's text added.


Make the README prettier

The README doesn't look great in markdown, so wrap the examples in code blocks, with a newline separating command and output.
Signed-off-by: Russell Currey<EMAIL_ADDRESS>

This change is

You can preview how this incredibly important change looks here: https://github.com/ruscur/pdbg/tree/patch-1

LGTM


[SPARK-31134][SQL] optimize skew join after shuffle partitions are coalesced

What changes were proposed in this pull request?

Run the OptimizeSkewedJoin rule after the CoalesceShufflePartitions rule.
Why are the changes needed?

Remove duplicated coalescing code in OptimizeSkewedJoin.
Does this PR introduce any user-facing change?

No
How was this patch tested?

existing tests

Test build #119721 has started for PR 27893 at commit 4b8a195.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24449/
Test PASSed.

cc @maryannxue @JkSelf

Test build #119721 has finished for PR 27893 at commit 4b8a195.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119721/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24566/
Test PASSed.

Test build #119837 has started for PR 27893 at commit fbf616c.

Test build #119839 has started for PR 27893 at commit d7e55e8.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24569/
Test PASSed.

Test build #119840 has started for PR 27893 at commit a66933b.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24570/
Test PASSed.

Test build #119839 has finished for PR 27893 at commit d7e55e8.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Test build #119840 has finished for PR 27893 at commit a66933b.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Test build #119837 has finished for PR 27893 at commit fbf616c.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119840/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119839/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119837/
Test FAILed.

retest this please

Test build #119841 has started for PR 27893 at commit a66933b.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24571/
Test PASSed.

Test build #119841 has finished for PR 27893 at commit a66933b.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119841/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24606/
Test PASSed.

Test build #119878 has started for PR 27893 at commit ba07313.

Test build #119881 has started for PR 27893 at commit 89ab703.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24610/
Test PASSed.

Test build #119883 has started for PR 27893 at commit c67590a.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24611/
Test PASSed.

Test build #119878 has finished for PR 27893 at commit ba07313.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119878/
Test PASSed.

Test build #119881 has finished for PR 27893 at commit 89ab703.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119881/
Test PASSed.

Test build #119883 has finished for PR 27893 at commit c67590a.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119883/
Test PASSed.

LGTM

Thanks! Merged to master/3.0


[Vendor] Fix Version Compare Lib

close #12731
test: https://play.golang.org/p/WgUmgbn1uN7

upstream pull: https://github.com/hashicorp/go-version/pull/77

Codecov Report

Merging #12735 into master will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master   #12735   +/-   ##
=======================================
  Coverage   43.40%   43.40%
=======================================
  Files         648      648
  Lines       71548    71548
=======================================
+ Hits        31053    31056    +3
+ Misses      35468    35463    -5
- Partials     5027     5029    +2

Impacted Files
Coverage Δ

modules/git/git.go
40.00% <ø> (ø)

modules/indexer/stats/db.go
43.47% <0.00%> (-17.40%)
:arrow_down:

modules/indexer/stats/queue.go
64.70% <0.00%> (-11.77%)
:arrow_down:

modules/git/repo.go
49.74% <0.00%> (-1.02%)
:arrow_down:

models/issue_comment.go
53.90% <0.00%> (+0.15%)
:arrow_up:

services/pull/pull.go
42.03% <0.00%> (+0.46%)
:arrow_up:

models/error.go
35.32% <0.00%> (+0.51%)
:arrow_up:

services/pull/check.go
50.00% <0.00%> (+2.30%)
:arrow_up:

models/unit.go
49.31% <0.00%> (+2.73%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 78509b5...4f7a59d. Read the comment docs.

@techknowlogick thanks

cheers fellows 🚀


Refactor OMs to use "m" property of Pokemon

Quite often temporary OMs wind up needing to store arbitrary properties to a Pokemon, which TypeScript won't allow. The solution, brought up on #4952 , was to give Pokemon a "data" property with type AnyObject. This reduces the need for ts-ignores and properties that were only defined to be used by one OM.
"data" is a working name; other possibilities include clearer names like "miscData" or "otherData", or single-letter names like "d" The name "m" was decided

.m for "mod data" might be nice. We do already use Dex.data to store the Dex data tables, so a different name here might be important.

Looks good! I like it a lot!

Do you need help rebasing?

probably 😔

Use these bash commands (in Windows, type them into Git Bash).
git remote add upstream git@github.com:Zarel/Pokemon-Showdown.git

This lets you access the official repository using the name upstream.
git checkout master
git pull upstream master
git push

This updates your master branch to the latest version from upstream.
git checkout pokemon-dot-data
git rebase master

This takes your commits from pokemon-dot-data, and puts them on top of the latest master.
At this point, you'll get a conflict in config/formats.js Go and edit that file and handle the merge. VS Code has some merge tools, but any text editor should make it reasonably clear.
git add .
git rebase --continue

You might get multiple conflicts, in which case you'll have to edit the conflicting file, and then run git add . and git rebase --continue again.
At some point, Git will be done rebasing.
git push --force-with-lease

This will push your rebased changes. The --force part is necessary because rebasing changes history, which Git considers a somewhat-dangerous operation.

Yay! Looks like you were successful in rebasing.

Whoops, seems we all abandoned this, I'm closing for the time being, maybe someone can come back to this?

No, this is still something I'm interested in.

Rebased, @Zarel

Follow-up questions: Do we want m as a property for Move? Side? Battle?

thanks all


Excessive Wan connectivity check, resulting in high cpu usage

I discovered that my firezone instance, was using 1 full core of CPU with the process "beam.smp".
It looks like it has something to do with "Wan Connectivity Check", because according to my pihole, for the last 5hours or so, my firezone has requested a ping to ping.firez.one about 5 times / second.
I can also confirm that from inside firezone, it has quite a lot of connectivity checks for the same minute:
https://imgur.com/a/iOK6RvS
As can be seen on the screenshot, i am running firezone 0.7.12, i am not entirely sure when this started, but i have restarted my firezone docker instance a couple of times in the last week, because it started using so much cpu, and then i investigated it this morning, since it was back.
Please let me know if any additional information is needed.
/Rolf

0.7.13 is out -- please upgrade :-).


add mask to multi-head attention

to mimic the keras code to mask the multi-head attention

seems the mask is never triggered. issue closed


feat: add eventbridge example project

first time I tried to deploy this I got:

eventbridge-stack: creating CloudFormation changeset...
2:37:00 PM | CREATE_FAILED        | AWS::Pipes::Pipe            | gamescoresdemocacheputpipe
Resource handler returned message: "Resource of type 'AWS::Pipes::Pipe' with identifier 'game-scores-demo-cache-put-p
ipe' did not stabilize. Status Reason is Input parameter is invalid from the request due to : Error occurred while se
nding message to SQS queue: arn:aws:sqs:us-west-2:266697619022:game-scores-demo-dlq" (RequestToken: c4ddbf29-717d-1f9
4-a67d-ffbf3ac0341e, HandlerErrorCode: NotStabilized)

 ❌  eventbridge-stack failed: Error: The stack named eventbridge-stack failed creation, it may need to be manually deleted from the AWS console: ROLLBACK_COMPLETE: Resource handler returned message: "Resource of type 'AWS::Pipes::Pipe' with identifier 'game-scores-demo-cache-put-pipe' did not stabilize. Status Reason is Input parameter is invalid from the request due to : Error occurred while sending message to SQS queue: arn:aws:sqs:us-west-2:266697619022:game-scores-demo-dlq" (RequestToken: c4ddbf29-717d-1f94-a67d-ffbf3ac0341e, HandlerErrorCode: NotStabilized)
    at FullCloudFormationDeployment.monitorDeployment (/Users/cprice/git/momento/client-sdk-javascript/examples/nodejs/eventbridge/infrastructure/node_modules/aws-cdk/lib/index.js:435:10568)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Object.deployStack2 [as deployStack] (/Users/cprice/git/momento/client-sdk-javascript/examples/nodejs/eventbridge/infrastructure/node_modules/aws-cdk/lib/index.js:438:199515)
    at async /Users/cprice/git/momento/client-sdk-javascript/examples/nodejs/eventbridge/infrastructure/node_modules/aws-cdk/lib/index.js:438:181237

 ❌ Deployment failed: Error: The stack named eventbridge-stack failed creation, it may need to be manually deleted from the AWS console: ROLLBACK_COMPLETE: Resource handler returned message: "Resource of type 'AWS::Pipes::Pipe' with identifier 'game-scores-demo-cache-put-pipe' did not stabilize. Status Reason is Input parameter is invalid from the request due to : Error occurred while sending message to SQS queue: arn:aws:sqs:us-west-2:266697619022:game-scores-demo-dlq" (RequestToken: c4ddbf29-717d-1f94-a67d-ffbf3ac0341e, HandlerErrorCode: NotStabilized)
    at FullCloudFormationDeployment.monitorDeployment (/Users/cprice/git/momento/client-sdk-javascript/examples/nodejs/eventbridge/infrastructure/node_modules/aws-cdk/lib/index.js:435:10568)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Object.deployStack2 [as deployStack] (/Users/cprice/git/momento/client-sdk-javascript/examples/nodejs/eventbridge/infrastructure/node_modules/aws-cdk/lib/index.js:438:199515)
    at async /Users/cprice/git/momento/client-sdk-javascript/examples/nodejs/eventbridge/infrastructure/node_modules/aws-cdk/lib/index.js:438:181237

The stack named eventbridge-stack failed creation, it may need to be manually deleted from the AWS console: ROLLBACK_COMPLETE: Resource handler returned message: "Resource of type 'AWS::Pipes::Pipe' with identifier 'game-scores-demo-cache-put-pipe' did not stabilize. Status Reason is Input parameter is invalid from the request due to : Error occurred while sending message to SQS queue: arn:aws:sqs:us-west-2:266697619022:game-scores-demo-dlq" (RequestToken: c4ddbf29-717d-1f94-a67d-ffbf3ac0341e, HandlerErrorCode: NotStabilized)

trying again

tried again and got a similar error:
Status Reason is Input parameter is invalid from the request due to : Cannot access stream arn:aws:dynamodb:us-west-2:266697619022:table/game-scores-demo/stream/2024-06-03T21:52:45.170.

This is looking really cool! Just some random things to tighten up I think.
For tomorrow (we can pair on this if you like):
CDK app:

Need to fix IAM stuff as per discussion on our call (no circular deps / pipes don't need to be in resource lists, DLQ needs to be in resource list)

Web app:

need to add support for VITE_APP_AWS_SESSION_TOKEN
maybe would be good to schedule a quick brainstorming call and have a couple people bounce ideas for UI layout?
do we need to support multiple caches for this demo?  or can we just hard-code a name like "momento-eventbridge-demo"?
need some kind of better alert if the cache doesn't exist. ideally a modal that links them to the console to create it?
i like that you're trying to tie it in to a real world use case like a game, but i think that the level/score stuff in the current UI is making it harder for me to understand what's being stored in DDB and in the cache, which seems important here. I wonder if we can just put a single textbox for the value? we can put some JSON in it and maybe have a button to randomize the JSON a bit or something?
we probably need to say something about the TTL here. otherwise if i click the "get" button after waiting for a bit, I get a "No data found" and it's not clear why. I almost think we should print the expiry in the subscribe box.
I want to add some text or description or code snippets inside of each of the boxes to make it more clear what's happening. so like, in the "subscribe to topic" box, maybe that subscribe snippet like we did in the console topic page. And then a little text describing when something will show up on the topic and why.
on the topic box I wanna maybe try to find a way to ensure they subscribe rather than relying on them to click the button
i almost wonder if we should add a "DDB Get" box as well (with a little ddb client code snippet) so they can do a get from either momento or the cache
if we do that ^^ then we will want to add a little code snippet for the momento get.
it might be cool to put some kind of arrows between the boxes to make it look/feel like a flowchart?

one more idea that we discussed on the call but i hadn't added to the pr comments:

in the "get" field, maybe we do both a ddb and momento fetch and show the latencies

haven't tested the new changes but a few nits just re: organization:

Can we move this into the aws examples parent dir?
Can we make the README a template?
Can we check the parent README files and add links to this one as necessary?

hit list of feedback from playing with web app:
Stuff we should fix before merging:

[ ] my cache didn't exist. The only way I knew it is because the subscription button was red/failed, and then I went to the JS console and saw Uncaught (in promise) Error: Unable to subscribe to topic: A cache with the specified name does not exist.  To resolve this error, make sure you have created the cache before attempting to use it: Cache not found    subscribeToTopic momento-web.ts:148

Stuff we should fix before sending the docs:

[ ] We should add some text explaining what's happening. Maybe a modal that shows up at startup that explains what things are, and then some code snippets to put into the various boxes. I can help you write the content if you need a hand!

Stuff we can fix after sending the docs:

[ ] when I didn't have the local code hacked to support AWS_SESSION_ID, my AWS creds weren't valid (expected). But the way I find out is by clicking "submit" on the dynamo panel and then i just get "Error creating item". can we maybe do some kind of sanity check for the AWS creds on page load and give a helpful error?
[ ] how come some of the env vars have to be prefixed with VITE_APP and some just with VITE? And on this topic - do they really require the prefix at all? Would be great to be able to just use the standard AWS env var names without the prefix.
[ ] can we focus on the first field in "Enter weather record" at startup?
[ ] Could we make the topic messages include an event type? So it's easy to distinguish the deletes from the writes?
[ ] Can we make the JSON field names in the topic messages match the DDB table schema column names exactly?
[ ] The latency numbers for the cache don't look better (or even as good as) the DDB ones. This might just be a web SDK thing. but if we can't find an optimization for that, we might want to remove that field.
[ ] I think maybe we can/should combine the two "Get" forms into a single one that does both the momento and DDB gets? and then we only need one form field and one find button?
[ ] I like what you did with the arrows in the middle! I wonder if we can shrink them just a bit to make them take up less vertical real estate though? Or maybe put the arrows on the sides of the ddb/momento boxes rather than below them, to get a few vertical pixels back?


feat(theme-default): add heroImageDark (close #526)

close #526

any update on this? :(
you can find a real-world example here why we need this


random augmentation in training phase evaluation

The standalone validate_on_lfw.py is fine.
However, if I provide args.lfw_dir during training,
train_softmax.py will evaluate on LFW every epoch.
But the result is slight different with  the standalone validate_on_lfw.py .
It might caused by random augmentation to LFW, which should only be applied to training set:
if args.random_rotate:
image = tf.py_func(facenet.random_rotate_image, [image], tf.uint8)
if args.random_crop:
image = tf.random_crop(image, [args.image_size, args.image_size, 3])
else:
image = tf.image.resize_image_with_crop_or_pad(image, args.image_size, args.image_size)
if args.random_flip:
image = tf.image.random_flip_left_right(image)
Could the feeding pipeline splits into two, one with random augmentation for train(), one without for evaluate() after each epoch?

Yes, this part needs to be changed to be able to disable augumentation by looking as phase_train.

Any solution yet?

This has been fixed in d7f5a3a6919f5c36d8d027a50665c849ba5f428a.


DWD Weather condition: wrong history (numerical instead of textual)

Version of home_assistant

Home Assistant
Core
2024.7.3
Supervisor
2024.06.2
Operating System
12.4
Frontend
20240710.0
Version of the custom_component

v2.1.4
Describe the bug
A clear and concise description of what the bug or error is and when it happens.
Steps to reproduce the issue:

Go to Setup > Entities
Select the condition (in German 'Wetterzustand') entity
In the dialog you can see the the condition (e.g. "sunny"), but also the text "No statistics found"
Click on Show more (in German 'Mehr anzeigen')
A numeric and empty graph will be opened,  instead of the textual history

Debug log

Add your logs here.

home-assistant_dwd_weather_2024-07-24T17-49-44.361Z.log

Thanks for reporting. However, I don't think this is something I can change. The weather condition is always reported as a string, so there shouldn't be numerical values available at any time.

OpenWheather can do it correctly like this:

Yes, I know. This integration can as well.
The history is nothing an integration takes care of, it's Homeassistant itself. So I guess your instance thinks this should be a numerical value but in fact it's not as displayed in the state.
I don't know where your instance got the numerical value in the first place, but you have to clean your history or adjust the internal settings of this sensor.


WIP: add towncrier integration

Closes https://github.com/ansible/molecule/issues/1779.
Follows from Git blunder in https://github.com/ansible/molecule/pull/1963.
Will be implementing changes requested in https://github.com/ansible/molecule/pull/1963#pullrequestreview-225475659. Done!

FYI: still a draft but has addressed all previous comments and advanced to "nearly done".

I'd like to declare what I will not be doing on this PR (out of scope):

Merging the existing change log with the new generated one
Making the new changelog look "just right"
Backporting existing unreleased changes into news fragments
Bikeshedding on further types we can include

Things I'll be focussing on:

Make tox changelog commands work correctly
Making sure all fragments generate correctly

I think I'll have to drop this for now. Hopefully someone can pick it up.

@decentral1se maybe I'll pick it up later. I'm also coming to the PyCon US where I plan to have a series of discussions about release automation and GitHub automation in general. Also looking forward to promoting http://docs.octomachinery.dev which dramatically simplifies those.
Let's keep it open for now, shall we?

Let's keep it open for now, shall we?

It's tracked in https://github.com/ansible/molecule/issues/1779.
I use my list of open issues/PRs to stay organised, so I prefer to close.


fix: golang function build for goversion above 1.17

Description of changes
Golang version above 1.17 has deprecated go get command and instead suggested to use go install
https://go.dev/doc/go-get-install-deprecation
To fix the issue in the local environment while working with amplify build function GoFunction -y, we need to change the command to fetch and install the github.com/aws/aws-lambda-go/cmd/build-lambda-zip.
Changes are made to work with golang version above > 1.17 and below it.

Issue #10564

Description of how you validated changes

[X] PR description included
[X] yarn test passes

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #10569 (0adeb8b) into master (8562acc) will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master   #10569   +/-   ##
=======================================
  Coverage   47.30%   47.30%
=======================================
  Files         665      665
  Lines       32880    32880
  Branches     6632     6632
=======================================
+ Hits        15554    15555    +1
+ Misses      15657    15656    -1
  Partials     1669     1669

Impacted Files
Coverage Δ

...li/src/domain/amplify-usageData/getUsageDataUrl.ts
100.00% <0.00%> (+12.50%)
:arrow_up:

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

Hi @sky4git, changes LGTM, thank you for your contribution!

@sky4git thanks again for the work here - do you mind rebasing this? Some package names changed and it's breaking the tests.

@sky4git thanks again for the work here - do you mind rebasing this? Some package names changed and it's breaking the tests.

Please check it again.


Issue with docker hub images

Hello Guys,
i don't know why but last tag on docker hub is 3.7.16.
The newest release on github is 3.8.0-rc
https://hub.docker.com/r/calcom/cal.com/tags

@buzzard10 hey sorry for the issues. We are actively looking at why these are failing.

@keithwillcode The latest calcom docker version has stopped to work.  The most recently Calcom Docker version that work is version 3.7.11 and version under 3.7.11
Version 3.7.15, 3.7.16 give the following error message:
yarn start
• Packages in scope: @calcom/web
• Running start in 1 packages
• Remote caching disabled
@calcom/web:start: cache bypass, force executing b0182874aa91d7f3
@calcom/web:start: Duplicate value found in common.json keys:   seats_available_other and seats_available_one
@calcom/web:start: Duplicate value found in common.json keys:   location_variable and location
@calcom/web:start: Duplicate value found in common.json keys:   additional_notes_variable and additional_notes
@calcom/web:start: Duplicate value found in common.json keys:   already_have_account and already_have_an_account
@calcom/web:start: Duplicate value found in common.json keys:   timezone_variable and timezone
@calcom/web:start: Duplicate value found in common.json keys:   scheduling_for_your_team and workflow_automation
@calcom/web:start: Duplicate value found in common.json keys:   saml_sso and saml_config
@calcom/web:start: Duplicate value found in common.json keys:   advanced_managed_events_description and unified_billing_description
@calcom/web:start:   ▲ Next.js 13.5.5
@calcom/web:start:   - Local:        http://localhost:3000
@calcom/web:start:
@calcom/web:start:  ✓ Ready in 1283ms
@calcom/web:start: 00:54:26:588	ERROR[redactError] Error:  {"name":"PrismaClientKnownRequestError","code":"P2021","clientVersion":"5.4.2","meta":{"table":"public.Feature"}}
@calcom/web:start: PrismaClientKnownRequestError:
@calcom/web:start: Invalid prisma.user.count() invocation:
@calcom/web:start:
@calcom/web:start:
@calcom/web:start: The table public.users does not exist in the current database.
@calcom/web:start:     at Cn.handleRequestError (/calcom/node_modules/@prisma/client/runtime/library.js:123:6817)
@calcom/web:start:     at Cn.handleAndLogRequestError (/calcom/node_modules/@prisma/client/runtime/library.js:123:6206)
@calcom/web:start:     at Cn.request (/calcom/node_modules/@prisma/client/runtime/library.js:123:5926)
@calcom/web:start:     at async l (/calcom/node_modules/@prisma/client/runtime/library.js:128:9968)
@calcom/web:start:     at async getServerSideProps (/calcom/apps/web/.next/server/pages/auth/login.js:1:10204) {
@calcom/web:start:   code: 'P2021',
@calcom/web:start:   clientVersion: '5.4.2',
@calcom/web:start:   meta: { table: 'public.users' }
@calcom/web:start: }
@calcom/web:start: react-i18next:: You will need to pass in an i18next instance by using initReactI18next

@mariushosting hello!
I can confirm that i have similar issue. After i've upgrade to the newest available image, i can't log in because i have error 500.
And Mariushosting, thank you for your great work! I'm a fan of your blog ;)

@mariushosting hello! I can confirm that i have similar issue. After i've upgrade to the newest available image, i can't log in because i have error 500.
And Mariushosting, thank you for your great work! I'm a fan of your blog ;)

In the meantime change the image calcom/cal.com:latest with image: calcom/cal.com:v3.7.11

@mariushosting i've already did that. Hope community will be able to figure out the problem and we'll be able to use it :)

@mariushosting i've already did that. Hope community will be able to figure out the problem and we'll be able to use it :)

Awesome! Just wait for @keithwillcode to look into this!

I have the same problem on my end, I confirm that the v3.7.11 tag is working.
Here's the anonymized logs if I start the v3.7.15 or newer builds:
✔ Container database  Created                                                                                0.0s   ✔ Container calcom    Recreated                                                                                0.3s  Attaching to calcom, database database  |  database  | PostgreSQL Database directory appears to contain a database; Skipping initialization database  |  database  | 2024-02-21 16:14:08.001 UTC [1] LOG:  starting PostgreSQL 16.2 (Debian 16.2-1.pgdg120+2) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit database  | 2024-02-21 16:14:08.002 UTC [1] LOG:  listening on IPv4 address "<IP_ADDRESS>", port 5432 database  | 2024-02-21 16:14:08.002 UTC [1] LOG:  listening on IPv6 address "::", port 5432 database  | 2024-02-21 16:14:08.019 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" database  | 2024-02-21 16:14:08.039 UTC [29] LOG:  database system was shut down at 2024-02-21 16:12:12 UTC database  | 2024-02-21 16:14:08.073 UTC [1] LOG:  database system is ready to accept connections calcom    | + scripts/replace-placeholder.sh http://localhost:3000 https://mywebsite calcom    | Replacing all statically built instances of http://localhost:3000 with https://mywebsite. calcom    | + scripts/wait-for-it.sh database:5432 -- echo database is up calcom    | nc command is missing! calcom    | + npx prisma migrate deploy --schema /calcom/packages/prisma/schema.prisma calcom    | Prisma schema loaded from packages/prisma/schema.prisma calcom    | Datasource "db": PostgreSQL database calcom    |  calcom    | Error: Prisma schema validation - (get-config wasm) calcom    | Error code: P1012 calcom    | error: Environment variable not found: DATABASE_DIRECT_URL. calcom    |   -->  schema.prisma:7 calcom    |    |  calcom    |  6 |   url       = env("DATABASE_URL") calcom    |  7 |   directUrl = env("DATABASE_DIRECT_URL") calcom    |    |  calcom    |  calcom    | Validation Error Count: 1 calcom    | [Context: getConfig] calcom    |  calcom    | Prisma CLI Version : 5.4.2 calcom    | npm notice  calcom    | npm notice New minor version of npm available! 10.2.3 -> 10.4.0 calcom    | npm notice Changelog: <https://github.com/npm/cli/releases/tag/v10.4.0> calcom    | npm notice Run npm install -g<EMAIL_ADDRESS>update! calcom    | npm notice  calcom    | + npx ts-node --transpile-only /calcom/packages/prisma/seed-app-store.ts calcom    | 📲 Updated app: 'apple-calendar' calcom    | 📲 Updated app: 'caldav-calendar' calcom    | Error adding google credentials to DB: Cannot destructure property 'client_secret' of 'JSON.parse(...).web' as it is undefined. calcom    | 📲 Updated app: 'office365-calendar' calcom    | 📲 Updated app: 'msteams' calcom    | 📲 Updated app: 'zoom' calcom    | 📲 Updated app: 'jitsi' calcom    | 📲 Updated app: 'wipe-my-cal' calcom    | 📲 Updated app: 'make' calcom    | 📲 Updated app: 'huddle01' calcom    | 📲 Updated app: 'alby' calcom    | 📲 Updated app: 'amie' calcom    | 📲 Updated app: 'apple-calendar' calcom    | 📲 Updated app: 'around' calcom    | 📲 Updated app: 'basecamp3' calcom    | 📲 Updated app: 'cal-ai' calcom    | 📲 Updated app: 'caldav-calendar' calcom    | 📲 Updated app: 'campfire' calcom    | 📲 Updated app: 'closecom' calcom    | 📲 Updated app: 'cron' calcom    | 📲 Updated app: 'daily-video' calcom    | 📲 Updated app: 'deel' calcom    | 📲 Updated app: 'discord' calcom    | 📲 Updated app: 'eightxeight' calcom    | 📲 Updated app: 'element-call' calcom    | 📲 Updated app: 'exchange2013-calendar' calcom    | 📲 Updated app: 'exchange2016-calendar' calcom    | 📲 Updated app: 'exchange' calcom    | 📲 Updated app: 'facetime' calcom    | 📲 Updated app: 'fathom' calcom    | 📲 Updated app: 'feishu-calendar' calcom    | 📲 Updated app: 'ga4' calcom    | 📲 Updated app: 'giphy' calcom    | 📲 Updated app: 'google-calendar' calcom    | 📲 Updated app: 'google-meet' calcom    | 📲 Updated app: 'gtm' calcom    | 📲 Updated app: 'hubspot' calcom    | 📲 Updated app: 'huddle01' calcom    | 📲 Updated app: 'ics-feed' calcom    | 📲 Updated app: 'intercom' calcom    | 📲 Updated app: 'jitsi' calcom    | 📲 Updated app: 'lark-calendar' calcom    | 📲 Updated app: 'make' calcom    | 📲 Updated app: 'matomo' calcom    | 📲 Updated app: 'metapixel' calcom    | 📲 Updated app: 'mirotalk' calcom    | 📲 Updated app: 'mock-payment-app' calcom    | 📲 Updated app: 'n8n' calcom    | 📲 Updated app: 'office365-calendar' calcom    | 📲 Updated app: 'msteams' calcom    | 📲 Updated app: 'paypal' calcom    | 📲 Updated app: 'ping' calcom    | 📲 Updated app: 'pipedream' calcom    | 📲 Updated app: 'pipedrive-crm' calcom    | 📲 Updated app: 'plausible' calcom    | 📲 Updated app: 'qr_code' calcom    | 📲 Updated app: 'raycast' calcom    | 📲 Updated app: 'riverside' calcom    | 📲 Updated app: 'roam' calcom    | 📲 Updated app: 'routing-forms' calcom    | 📲 Updated app: 'salesforce' calcom    | 📲 Updated app: 'salesroom' calcom    | 📲 Updated app: 'sendgrid' calcom    | 📲 Updated app: 'shimmervideo' calcom    | 📲 Updated app: 'signal' calcom    | 📲 Updated app: 'sirius_video' calcom    | 📲 Updated app: 'skiff' calcom    | 📲 Updated app: 'stripe' calcom    | 📲 Updated app: 'sylapsvideo' calcom    | 📲 Updated app: 'tandem' calcom    | 📲 Updated app: 'telegram' calcom    | 📲 Updated app: 'typeform' calcom    | 📲 Updated app: 'vimcal' calcom    | 📲 Updated app: 'vital-automation' calcom    | 📲 Updated app: 'weather_in_your_calendar' calcom    | 📲 Updated app: 'webex' calcom    | 📲 Updated app: 'whatsapp' calcom    | 📲 Updated app: 'whereby' calcom    | 📲 Updated app: 'wipe-my-cal' calcom    | 📲 Updated app: 'wordpress' calcom    | 📲 Updated app: 'zapier' calcom    | 📲 Updated app: 'zoho-bigin' calcom    | 📲 Updated app: 'zohocalendar' calcom    | 📲 Updated app: 'zohocrm' calcom    | 📲 Updated app: 'zoom' database  | 2024-02-21 16:14:16.806 UTC [33] ERROR:  column users.movedToProfileId does not exist at character 1281 database  | 2024-02-21 16:14:16.806 UTC [33] STATEMENT:  SELECT "public"."users"."id", "public"."users"."username", "public"."users"."name", "public"."users"."email", "public"."users"."emailVerified", "public"."users"."password", "public"."users"."bio", "public"."users"."avatar", "public"."users"."avatarUrl", "public"."users"."timeZone", "public"."users"."weekStart", "public"."users"."startTime", "public"."users"."endTime", "public"."users"."bufferTime", "public"."users"."hideBranding", "public"."users"."theme", "public"."users"."created", "public"."users"."trialEndsAt", "public"."users"."defaultScheduleId", "public"."users"."completedOnboarding", "public"."users"."locale", "public"."users"."timeFormat", "public"."users"."twoFactorSecret", "public"."users"."twoFactorEnabled", "public"."users"."backupCodes", "public"."users"."identityProvider"::text, "public"."users"."identityProviderId", "public"."users"."invitedTo", "public"."users"."brandColor", "public"."users"."darkBrandColor", "public"."users"."away", "public"."users"."allowDynamicBooking", "public"."users"."allowSEOIndexing", "public"."users"."receiveMonthlyDigestEmail", "public"."users"."metadata", "public"."users"."verified", "public"."users"."role"::text, "public"."users"."disableImpersonation", "public"."users"."organizationId", "public"."users"."locked", "public"."users"."movedToProfileId" FROM "public"."users" WHERE "public"."users"."username" = $1 LIMIT $2 OFFSET $3 calcom    | PrismaClientKnownRequestError:  calcom    | Invalidprisma.user.findFirst()invocation: calcom    |  calcom    |  calcom    | The columnusers.movedToProfileIddoes not exist in the current database. calcom    |     at Cn.handleRequestError (/calcom/node_modules/@prisma/client/runtime/library.js:123:6817) calcom    |     at Cn.handleAndLogRequestError (/calcom/node_modules/@prisma/client/runtime/library.js:123:6206) calcom    |     at Cn.request (/calcom/node_modules/@prisma/client/runtime/library.js:123:5926) calcom    |     at async l (/calcom/node_modules/@prisma/client/runtime/library.js:128:9968) calcom    |     at async seedAppData (/calcom/packages/prisma/seed-app-store.ts:31:19) calcom    |     at async main (/calcom/packages/prisma/seed-app-store.ts:384:3) { calcom    |   code: 'P2022', calcom    |   clientVersion: '5.4.2', calcom    |   meta: { column: 'users.movedToProfileId' } calcom    | } calcom    | + yarn start calcom    | • Packages in scope: @calcom/web calcom    | • Running start in 1 packages calcom    | • Remote caching disabled calcom    | @calcom/web:start: cache bypass, force executing 2f6df2db2c5d3dbe calcom    | @calcom/web:start: Duplicate value found in common.json keys:   seats_available_other and seats_available_one calcom    | @calcom/web:start: Duplicate value found in common.json keys:   location_variable and location calcom    | @calcom/web:start: Duplicate value found in common.json keys:   additional_notes_variable and additional_notes calcom    | @calcom/web:start: Duplicate value found in common.json keys:   already_have_account and already_have_an_account calcom    | @calcom/web:start: Duplicate value found in common.json keys:   timezone_variable and timezone calcom    | @calcom/web:start: Duplicate value found in common.json keys:   scheduling_for_your_team and workflow_automation calcom    | @calcom/web:start: Duplicate value found in common.json keys:   saml_sso and saml_config calcom    | @calcom/web:start: Duplicate value found in common.json keys:   advanced_managed_events_description and unified_billing_description calcom    | @calcom/web:start:   ▲ Next.js 13.5.5 calcom    | @calcom/web:start:   - Local:        http://localhost:3000 calcom    | @calcom/web:start:  calcom    | @calcom/web:start:  ✓ Ready in 978ms
So it seems like the ENV variables changed and need to add 'DATABASE_DIRECT_URL'.
In my .env file, I added an entry for this variable, with the same value as the older 'DATABASE_URL' variable.
With that change, I can run the v3.7.15 tags up to the latest available (v3.7.16).

So it seems like the ENV variables changed and need to add 'DATABASE_DIRECT_URL'. In my .env file, I added an entry for this variable, with the same value as the older 'DATABASE_URL' variable. With that change, I can run the v3.7.15 tags up to the latest available (v3.7.16).

Is that all that needs to be done to correct these errors? And we need both variables DATABASE_URL and DATABASE_DIRECT_URL?

See https://github.com/calcom/docker/issues/323

Is that all that needs to be done to correct these errors? And we need both variables DATABASE_URL and DATABASE_DIRECT_URL?

Adding DATABASE_DIRECT_URL did not change anything for me.

Working for me latest tags after adding env variable, in unraid server...thanks!

Any updates regarding availability of newest versions on docker hub?

Any updates regarding availability of newest versions on docker hub?

My container on unraid is running v.3.8.6-sh according to what I see at the bottom left corner of my settings page.
v3.8.6 is showing as the latest release on github: https://github.com/calcom/cal.com/releases
The repo on docker hub matches also: https://hub.docker.com/r/calcom/cal.com/tags
I was running 3.8.5-sh yesterday, but docker hub is only showing v3.7.16 as the previous tag, so not sure why it doesn't have anything in between.

Wow, great! I did not know that you could see the version of the image docker on the page of the platform cal.com selfhosted..Attachment screen capture with the image .. and what I see still not in the last image updated, but comment higher between v3.7.11 and the last there were errors that did not let enter to log in until entering the variables of environment mentioned..

After upgrade i have this issue:

After upgrade i have this issue:  There is also log from docker:

From which image of docker do you update? Do you have DATABASE_DIRECT_URL variables in your template?

Image: calcom/cal.com:v3.8.6
There is a DATABASE_URL param, but i don't see DATABASE_DIRECT_URL.

Create that variable DATABASE_DIRECT_URL and put the same data as you have in the variable DATABASE_URL

Now it seems working, thank you very much! :)


Constant not used in mob/animal spawning limits

Looking at the Mixin MixinWorldEntitySpawner.java file, I noticed the code uses the formula for maxCount as
int maxCount = limit * chunkSpawnCandidates / MOB_COUNT_DIV;
but a bit further down it recalculates it for the moblimit as
int mobLimit = (limit * chunkSpawnCandidates / 256) - entityCount + 1;
Shouldn't the 256 be the constant as well, or even just referencing the maxCount variable?

@bloodmc Can you comment on this?


Update documentation on joints' frames specifying defaults and conventions

Original report (archived issue) by Alejandro Castro (Bitbucket: amcastro0622).

Reading the documentation for an SDF's joint axis here I had the following questions:

use_parent_model_frame=true means...? the <model>  frame I believe, could it be confirmed? the word "parent" overloads with "parent body" in the same <joint> doc and thus the confusion.
use_parent_model_frame=false means... the "joint frame". How is this "joint frame" defined? where is the origin of this joint frame?

In version 1.6 the documentation for  does not state the default when the <pose> itself or the <frame> in which this pose is measured, are not specified.
However, version 1.4 doc does state that the default is the identity transform "in the child link frame" (ala urdf, makes sense).
The questions are:

Why didn't this doc make it to 1.6. Clearly default pose and frames need to be stated for a non-ambiguous description.
Unless the convention changed in 1.6?

It seems that, in current version 1.6 an old issue, 494, is mentioned. Is that fully resolved?
Finally, nothing is said about the joint frame on the "parent" body. It'd seem that the implicit convention is that this frame gets defined by making it coincident with the frame on the child body (referred to as, I believe, the "joint frame"). If this is true, it should be explicitly stated somewhere. If not, the documentation should be updated to reflect the actual convention.

this documentation is now available at http://sdformat.org/tutorials?tut=pose_frame_semantics&cat=specification&


feat: /api/v1/strucvars/csq endpoint with OpenAPI (#607)

CC @tedil here you can see the issues I mentionsed as= not working and recursive schema extraction not working.


/install-cni.sh  exited

Hello, when I deployed the latest version of calico, I encountered a very difficult problem to solve.
calico cni display exited：kubeneteres v14.2  calico v3.7.2
[root@master01 ~]# docker ps -a
CONTAINER ID        IMAGE                  COMMAND                  CREATED             STATUS                      PORTS               NAMES
d9e593d93f4e        dab36d1b271e           "/install-cni.sh"        58 seconds ago      Exited (0) 57 seconds ago                       k8s_install-cni_calico-node-9mwpj_kube-system_da469f8

[root@master01 ~]# docker logs d9e593d93f4e
Installing any TLS assets from /calico-secrets
Wrote Calico CNI binaries to /host/opt/cni/bin
CNI plugin version: v3.7.2
/host/secondary-bin-dir is non-writeable, skipping
Using CNI config template from CNI_NETWORK_CONFIG environment variable.
CNI config: {
  "name": "k8s-pod-network",
  "cniVersion": "0.3.0",
  "plugins": [
    {
      "type": "calico",
      "log_level": "info",
      "etcd_endpoints": "https://<IP_ADDRESS>:2379",
      "etcd_key_file": "/etc/kubernetes/pki/etcd/server.key",
      "etcd_cert_file": "/etc/kubernetes/pki/etcd/server.crt",
      "etcd_ca_cert_file": "/etc/kubernetes/pki/etcd/ca.crt",
      "mtu": 1440,
      "ipam": {
          "type": "calico-ipam"
      },
      "policy": {
          "type": "k8s"
      },
      "kubernetes": {
          "kubeconfig": "/etc/cni/net.d/calico-kubeconfig"
      }
    },
    {
      "type": "portmap",
      "snat": true,
      "capabilities": {"portMappings": true}
    }
  ]
}
Created CNI config 10-calico.conflist
Done configuring CNI.  Sleep=false

[root@master01 ~]# ls -ld calico-secrets
ls: cannot access calico-secrets: No such file or directory

[root@master01 ~]# kubectl get pods -n  kube-system
NAME                                       READY   STATUS    RESTARTS   AGE
calico-kube-controllers-5c78f7dbf5-j9sp4   1/1     Running   1          2d1h
calico-node-9mwpj                          1/1     Running   0          2d1h
calico-node-pdzw5                          1/1     Running   0          2d1h
coredns-fb8b8dccf-wzpjr                    1/1     Running   0          2d1h
coredns-fb8b8dccf-zh7t2                    1/1     Running   0          2d1h
etcd-master01                              1/1     Running   2          2d1h
kube-apiserver-master01                    1/1     Running   2          2d1h
kube-controller-manager-master01           1/1     Running   2          2d1h
kube-proxy-clp5w                           1/1     Running   2          2d1h
kube-proxy-zdxpw                           1/1     Running   0          2d1h
kube-scheduler-master01                    1/1     Running   2          2d1h

[root@master01 ~]# cd /etc/cni/net.d/
[root@master01 net.d]# ll
total 8
-rw-r--r-- 1 root root  698 Jun  9 09:50 10-calico.conflist
-rw------- 1 root root 2565 Jun  9 09:50 calico-kubeconfig
drwxr-xr-x 2 root root   54 Jun  9 09:50 calico-tls
[root@master01 net.d]# cat 10-calico.conflist
{
  "name": "k8s-pod-network",
  "cniVersion": "0.3.0",
  "plugins": [
    {
      "type": "calico",
      "log_level": "info",
      "etcd_endpoints": "https://<IP_ADDRESS>:2379",
      "etcd_key_file": "/etc/kubernetes/pki/etcd/server.key",
      "etcd_cert_file": "/etc/kubernetes/pki/etcd/server.crt",
      "etcd_ca_cert_file": "/etc/kubernetes/pki/etcd/ca.crt",
      "mtu": 1440,
      "ipam": {
          "type": "calico-ipam"
      },
      "policy": {
          "type": "k8s"
      },
      "kubernetes": {
          "kubeconfig": "/etc/cni/net.d/calico-kubeconfig"
      }
    },
    {
      "type": "portmap",
      "snat": true,
      "capabilities": {"portMappings": true}
    }
  ]
}

It looks like calico was installed successfully from the output of kubectl get pods, and the install cni script completed without problems and exited as expected. Are you seeing any other issues?

inpu "docker ps -a"  ，Calco-cni container runs in Exited state,It shouldn't be running?

Nope, the install-cni container runs to completion and exits when done. Are you seeing any other problems after this?

Nope, the install-cni container runs to completion and exits when done. Are you seeing any other problems after this?

tanks, no problems!


Progress control not updating the Spinner

Information

OS: Windows 10 19043.1165
Version: 0.41.0
Terminal: cmd, Terminal

Describe the bug
Creating a async Progress Control with a SpinnerColumn as shown on the documentation (https://spectreconsole.net/live/progress) when editing the shown Spinner on the column the spinner doesn't uses the specified style.
To Reproduce
                    .AutoRefresh(false) // Turn off auto refresh
                    .AutoClear(false)   // Do not remove the task list when done
                    .HideCompleted(false)   // Hide tasks as they are completed
                    .Columns(new ProgressColumn[]
                    {
                        new TaskDescriptionColumn(),    // Task description
                        new ProgressBarColumn(){
                            RemainingStyle = new Style(Color.Black,Color.Black,Decoration.SlowBlink),
                            FinishedStyle = new Style(Color.Green,Color.Green,Decoration.SlowBlink),
                            CompletedStyle= new Style(Color.Green,Color.Green,Decoration.SlowBlink),
                            },        // Progress bar
                        new PercentageColumn(),         // Percentage
                        new RemainingTimeColumn(),      // Remaining time
                        new SpinnerColumn(Spinner.Known.Grenade),            // Spinner
                    }).StartAsync(async ctx => // DO SOME WORK HERE AND UPDATE THE UI);

Expected behavior
The Progress control shows the Grenade Spinner.
Screenshots

@OnlyOnePro Thanks for reporting this, but this is not a bug. If the console output encoding isn't Unicode, it will fall back to the default ASCII spinner.
If you're running PowerShell, you can explicitly set the output encoding by running [console]::InputEncoding = [console]::OutputEncoding = New-Object System.Text.UTF8Encoding before your application, or set the output encoding explicitly with Console.OutputEncoding = Encoding.UTF8Encoding in your application.
Please note that there is no guarantee that the terminal is capable of rendering this correctly if it doesn't support Unicode.
You can check the output encoding in your console by running dotnet example info.

@OnlyOnePro I went ahead and closed this, but feel free to re-open if you think I closed this in error, or if you can't get it to work in a terminal with output encoding set to Unicode.


Cross Schema Dependencies

Another issue we are having is cross schema dependencies. Reading the documentation this is supposed to work so could be user error.
For example
schema_one/table/my_table.sql
//// CHANGE name=create
CREATE TABLE my_table (
  col1  INT2 NOT NULL,
  col2 INT2 NOT NULL
)
GO

//// CHANGE name=foreign_key
ALTER TABLE my_table
  ADD CONSTRAINT foreign_key_example
FOREIGN KEY (col1)
REFERENCES schema_two.linked_table (col1)
MATCH SIMPLE
GO

schema_two/table/linked_table.sql
//// CHANGE name=create
CREATE TABLE linked_table (
  col1  INT2 NOT NULL,
  col2 INT2 NOT NULL
)
GO

I would expect when deploying this, obevo would find the dependency and therefore execute the linked_table creation first. This does not happen though.
Both schemas are included in the system-config.xml like this:
    <schemas>
        <schema name="schema_one"/>
        <schema name="schema_two"/>
    </schemas>

However it does seem to work when both tables are in the same schema.
Thanks,
Ivan

Hi Ivan,
You are correct that the automatic discovery from text only works if it is in the same schema, and not across schemas.
For now, you can enforce the order using the "includeDependencies" attribute per the doc. Example below:
//// CHANGE name=foreign_key includeDependencies=schema_two.linked_table.create
You can also depend on the object itself; for tables, this will default to the last change in the file:
//// CHANGE name=foreign_key includeDependencies=schema_two.linked_table
Note - use the logical schema name when declaring the dependency, not the physical. i.e. if you map schema_one to schema_one_dev in one of your environments, your code should still refer to the dependency as schema_one.mytable
I will keep this issue open to track the feature for supporting dynamic cross schema dependencies.

I will try this on my side and get back to you

The "includeDependencies" attribute should ideally work, but it looks like a bug on our side; I will look into that.
In the meantime, use the "dependencies" attribute
//// CHANGE name=foreign_key dependencies=schema_two.linked_table
ALTER TABLE my_table
  ADD CONSTRAINT foreign_key_example
FOREIGN KEY (col1)

Updating the TODO for this ticket

Implement this cross-schema dependency discovery, notably in TextDependencyExtractor
Ensure that the explicit dependencies / includeDependencies have unit tests (notably for GraphEnricherImpl). I believe the includeDependencies issue in the last comment has been fixed; just need a double-check on the tests


Show sync progress

When trying to send, the wallet says "node still syncing", so it seems to have some awareness when it's not caught up to the chain tip. Could this awareness also be used to show progress during syncing? Right now the wallet just shows the current block height synced. But could it also show what the current chain tip is so I can see I have synced X out of Y blocks?

The limitation here is that the zcashd RPC doesn't have a lot of info on the syncing, so we only show the sync percentage in the status bar on the bottom right.
If you're using the embedded zcashd, however, you see all the info on the zcashd tab, including the estimated number of blocks remaining and percentage progress.
There's an issue filed with zcashd to track the issue here: https://github.com/zcash/zcash/issues/3726

Closing this, since there's already an issue on zcashd


cross-reference the addresses for the dataAccessList (sign vs. encrypt)

The old P8eMemorializeContract handler on the blockchain seems to be setting the dataAccessList to the address of the parties' signing key, when it is expected by the sdk to be the encryption key (as that is the key used to share data out to)... Fortunately the sdk can already look the affiliates up by either address to retrieve the registered encryption public key, so this just updates the check to be more flexible

Codecov Report

Merging #48 (76d11a4) into main (bedb36c) will decrease coverage by 0.01%.
The diff coverage is 85.18%.

@@             Coverage Diff              @@
##               main      #48      +/-   ##
============================================
- Coverage     80.01%   80.00%   -0.02%
- Complexity      137      142       +5
============================================
  Files            19       19
  Lines          1111     1130      +19
  Branches        123      127       +4
============================================
+ Hits            889      904      +15
  Misses          157      157
- Partials         65       69       +4

Impacted Files
Coverage Δ

...lin/io/provenance/scope/sdk/AffiliateRepository.kt
71.42% <71.42%> (-3.58%)
:arrow_down:

...n/kotlin/io/provenance/scope/sdk/SessionBuilder.kt
90.99% <89.47%> (-0.44%)
:arrow_down:

.../src/main/kotlin/io/provenance/scope/sdk/Client.kt
74.60% <100.00%> (ø)

.../src/main/kotlin/io/provenance/scope/sdk/Config.kt
81.81% <0.00%> (+1.81%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bedb36c...76d11a4. Read the comment docs.


'auth.checkPhone' always return true

It seems the "auth.checkPhone" api always return true no matter what telephone number (e.g. "123", "xyz", "123abc") I pass. Do you guys have any idea?

我现在也碰到了这样的问题 ，不管用什么手机号 都返回的是true
{ phone_registered: true, phone_invited: undefined }


CDK8s import - 1.19 Kubernetes API Spec is Missing

Description of the bug:

cdk8s import fails when trying to import API version higher than 1.18
cdk8s import<EMAIL_ADDRESS>--language typescript
Reproduction Steps:

cdk8s import<EMAIL_ADDRESS>--language typescript
Error Log:

/usr/local/Cellar/cdk8s/0.33.0/libexec/lib/node_modules/cdk8s-cli/lib/util.js:74
throw new Error(${res.statusMessage}: ${url});
^
Error: Not Found: https://raw.githubusercontent.com/instrumenta/kubernetes-json-schema/master/v1.19.0/_definitions.json
at ClientRequest.client.get.res (/usr/local/Cellar/cdk8s/0.33.0/libexec/lib/node_modules/cdk8s-cli/lib/util.js:74:27)
at Object.onceWrapper (events.js:273:13)
at ClientRequest.emit (events.js:182:13)
at HTTPParser.parserOnIncomingClient [as onIncoming] (_http_client.js:546:21)
at HTTPParser.parserOnHeadersComplete (_http_common.js:109:17)
at TLSSocket.socketOnData (_http_client.js:432:20)
at TLSSocket.emit (events.js:182:13)
at addChunk (_stream_readable.js:283:12)
at readableAddChunk (_stream_readable.js:264:11)
at TLSSocket.Readable.push (_stream_readable.js:219:10)
S286443:hpav2betav2 car6807$ NODE_TLS_REJECT_UNAUTHORIZED=0 cdk
Environment:

Framework Version:
OS:

Other:

This is :bug: Bug Report

It looks like this issue is resolved, cdk8s import for all available k8s versions seems to be working on the latest version (v1.0.0-beta.27).


Clipboard Access Denied Error

I was attempting to switch over from pyperclip to jaraco.clipboard and I'm immediately running into problems when running unit tests that were passing before the conversion.  Nothing fancy, just text in the Win 10 clipboard, but its throwing an exception error and I'm thinking if jaraco.clipboard is mostly just a wrapper for the underlying libraries then this shouldn't be happening.
Here's the relevant tail end of the Traceback.  Prior to this is the unit test details which is not relevant.
File "C:\Program Files\Python38\lib\site-packages\jaraco\windows\clipboard.py", line 168, in set_unicode_text
    with context():
  File "C:\Program Files\Python38\lib\contextlib.py", line 113, in __enter__
    return next(self.gen)
  File "C:\Program Files\Python38\lib\site-packages\jaraco\windows\clipboard.py", line 207, in context
    OpenClipboard()
  File "C:\Program Files\Python38\lib\site-packages\jaraco\windows\clipboard.py", line 30, in OpenClipboard
    handle_nonzero_success(windll.user32.OpenClipboard(owner))
  File "C:\Program Files\Python38\lib\site-packages\jaraco\windows\error.py", line 85, in handle_nonzero_success
    raise WindowsError()
jaraco.windows.error.WindowsError: Access is denied.

As you can see the installation is to Program Files which is for all users of this PC which does require use of elevated admin rights to perform installations and such, but shouldn't pose this particular problem unless there is some sort of delegation that is or is not happening.

Thanks for the report. You're right that jaraco.clipboard is mainly a thin wrapper around jaraco.windows when running on Windows. You probably would get the same error if you were to run jaraco.windows.clipboard.set_unicode_text("foo").
The error message Access is denied. comes from Windows, so for some reason, Windows thinks that the user running the Python executable does not have privilege to set text on the clipboard. That seems like a pretty basic functionality, but honestly, I don't know enough about Windows or its user access controls to say for certain.
What I can say with confidence is that the tests that set unicode text do in fact pass on the Windows test runners (example), so there's something else peculiar to your environment that's causing the errors.
You mentioned that you're not running with elevated admin rights - have you tried running with them? Can you think of anything else in your environment that may be restricting your access to the clipboard? I don't see anything in the api docs for OpenClipboard that explain why access would be denied.
Probably your best bet here is to take a simple Python script that replicates underlying error and work with support avenues for Windows on the issue. Probably this command should replicate the issue:
python -c "import ctypes; assert ctypes.windll.user32.OpenClipboard(None) > 0"

It runs to completion on my Windows machine without error. I suspect the assertion will fail in your environment.
Feel free to report back if I can provide more details and especially if you've found some defect with jaraco.clipboard. If you find something that should be improved in jaraco.windows instead, feel free to file a bug there (or comment here and I'll transfer the issue).
In the meantime, I'm going to close this as it's unlikely to be actionable for this project.


Duplicate ProjectReference's breaks cross-targeting frameworks

From @natemcmaster on November 8, 2017 1:28
When there are duplicate ProjectReference's, MSBuild will use the wrong TargetFrameworks value when building P2P references. This used to work in 2.0.0 but started failing in nightly builds of 2.2.0.
Repro:
Microsoft.AspNetCore.Authentication.Test (netcoreapp2.0;net461)
   ProjectReferences
   ---> Microsoft.AspNetCore.Authentication.Cookies  (netstandard2.0)
   ---> Microsoft.AspNetCore.Authentication.Facebook  (netstandard2.0)
   ---> Microsoft.AspNetCore.Authentication.Google  (netstandard2.0)
   ---> Microsoft.AspNetCore.Authentication.JwtBearer  (netstandard2.0)
   ---> Microsoft.AspNetCore.Authentication.MicrosoftAccount  (netstandard2.0)
   ---> Microsoft.AspNetCore.Authentication.OpenIdConnect  (netstandard2.0)
   ---> Microsoft.AspNetCore.Authentication.MicrosoftAccount  (netstandard2.0)  (DUPLICATE)
   ---> Microsoft.AspNetCore.Authentication.JwtBearer  (netstandard2.0) (DUPLICATE)
   ---> Microsoft.AspNetCore.Authentication.Twitter  (netstandard2.0)

Install nightly build of the CLI: https://dotnetcli.blob.core.windows.net/dotnet/Sdk/2.2.0-preview1-007522/dotnet-sdk-2.2.0-preview1-007522-win-x64.zip
git clone https://github.com/aspnet/Security
git checkout 72e1cb1385c982e6dba90c839d1a1455e2813e6c
cd Security/test/Microsoft.AspNetCore.Authentication.Test
dotnet restore
dotnet build --no-restore

Expected
Microsoft.AspNetCore.Authentication.MicrosoftAccount and Microsoft.AspNetCore.Authentication.JwtBearer should be built using TargetFramework=netstandard2.0
Or, produce an error about duplicate ProjectReferences are ignored or produce some kind of warning.
Actual
MSBuild attempts to compile Microsoft.AspNetCore.Authentication.MicrosoftAccount and Microsoft.AspNetCore.Authentication.JwtBearer  with both net461 and netcoreapp2.0.
C:\Users\namc\.dotnet\x64\sdk\2.2.0-preview1-007460\Sdks\Microsoft.NET.Sdk\build\Microsoft.PackageDependencyResolution.targets(165,5): error : Assets file 'C:\dev\aspnet\Universe21\modules\Security\src\Microsoft.AspNetCore.Authentication.MicrosoftAccount\obj\project.assets.json' doesn't have a target for '.NETCoreApp,Version=v2.0'. Ensure that restore has run and that you have included 'netcoreapp2.0' in the TargetFrameworks for your project. [C:\dev\aspnet\Universe21\modules\Security\src\Microsoft.AspNetCore.Authentication.MicrosoftAccount\Microsoft.AspNetCore.Authentication.MicrosoftAccount.csproj]
C:\Users\namc\.dotnet\x64\sdk\2.2.0-preview1-007460\Sdks\Microsoft.NET.Sdk\build\Microsoft.PackageDependencyResolution.targets(165,5): error : Assets file 'C:\dev\aspnet\Universe21\modules\Security\src\Microsoft.AspNetCore.Authentication.JwtBearer\obj\project.assets.json' doesn't have a target for '.NETCoreApp,Version=v2.0'. Ensure that restore has run and that you have included 'netcoreapp2.0' in the TargetFrameworks for your project. [C:\dev\aspnet\Universe21\modules\Security\src\Microsoft.AspNetCore.Authentication.JwtBearer\Microsoft.AspNetCore.Authentication.JwtBearer.csproj]
C:\Users\namc\.dotnet\x64\sdk\2.2.0-preview1-007460\Sdks\Microsoft.NET.Sdk\build\Microsoft.PackageDependencyResolution.targets(165,5): error : Assets file 'C:\dev\aspnet\Universe21\modules\Security\src\Microsoft.AspNetCore.Authentication.MicrosoftAccount\obj\project.assets.json' doesn't have a target for '.NETFramework,Version=v4.6.1'. Ensure that restore has run and that you have included 'net461' in the TargetFrameworks for your project. [C:\dev\aspnet\Universe21\modules\Security\src\Microsoft.AspNetCore.Authentication.MicrosoftAccount\Microsoft.AspNetCore.Authentication.MicrosoftAccount.csproj]
C:\Users\namc\.dotnet\x64\sdk\2.2.0-preview1-007460\Sdks\Microsoft.NET.Sdk\build\Microsoft.PackageDependencyResolution.targets(165,5): error : Assets file 'C:\dev\aspnet\Universe21\modules\Security\src\Microsoft.AspNetCore.Authentication.JwtBearer\obj\project.assets.json' doesn't have a target for '.NETFramework,Version=v4.6.1'. Ensure that restore has run and that you have included 'net461' in the TargetFrameworks for your project. [C:\dev\aspnet\Universe21\modules\Security\src\Microsoft.AspNetCore.Authentication.JwtBearer\Microsoft.AspNetCore.Authentication.JwtBearer.csproj]

Details
Microsoft.AspNetCore.Authentication.Test.csproj
Microsoft.AspNetCore.Authentication.MicrosoftAccount.csproj
Microsoft.AspNetCore.Authentication.JwtBearer.csproj
Build log: msbuild.binlog.zip
Copied from original issue: dotnet/sdk#1716

We believe this regressed when we did the fix for duplicate evaluation of project references.

Duplicate of #2688.
Looking at these projects, it looks like the duplication is a project-authoring error. Is it something that you need to support, or would an error about the duplication be ok? (Not defending the current behavior, trying to figure out how well we need to fix it.)

Definitely a project authoring error which is easy to fix, but the error message produced is misleading. I was expecting a warning or an error indicating the real issue was duplicated project references.