Assign Layers to value of timeline

Hello, im actually working on a school project using Leaflet.
I've just came across the leaflet-timeline-slider and i want to assign different layers to each value of the timeline so that the user can navigate through it.
But i'm having some issues.
I've created an array of imageOverlays and placed it in a featuregroup
now i want to assign it to the different values in the timeline
for e.g clicking on value "8 30" will display "layer_0830_1"
and clicking on value "9 00" will display the second layer and so on.
but while displaying other layers, the existing layers should be cleared from the map.
Your help will be appreciated a lot, since i need to submit this soon!
Code:
**changeFloodMap = function({value}){
var array = [layer_0830_1, layer_0900_2, layer_0930_3, layer_1000_4, layer_1030_5, layer_1100_6, layer_1130_7, layer_1200_8, layer_1230_9, layer_1300_10];
      var group = L.featureGroup(array);

      group.eachLayer(function(layer){
        if (layer instanceof map){
             map.removeLayer(layer);
        });
        map.addLayer(layer);
    };

    L.control.timelineSlider({
        timelineItems: ["08 30", "09 00", "09 30", "10 00", "10 30", "11 00", "11 30", "12 00", "12 30" , "13 00"],
        changeMap: changeFloodMap}).addTo(map);**

Hard to tell without more details on what the layers in the array are, but in the code you posted
group.eachLayer(...), shouldn't you be doing map.eachLayer(...)  to remove the layers from the actual map object.

This is the code for the layers
        var img_0830_1 = 'data/0830_1.png';
        var img_bounds_0830_1 = [[-20.057853477144814,57.575627574783994],[-20.034769614576177,57.60180083977471]];
        var layer_0830_1 = new L.imageOverlay(img_0830_1, img_bounds_0830_1);

        var img_0900_2 = 'data/0900_2.png';
        var img_bounds_0900_2 = [[-20.057853477144814,57.575627574783994],[-20.034769614576177,57.60180083977471]];
        var layer_0900_2 = new L.imageOverlay(img_0900_2, img_bounds_0900_2);

The layer is  png file and i want to appear over on my google street map which is the base map
        googleStreet = L.tileLayer('https://{s}.tile.openstreetmap.org/{z}/{x}/{y}.png', {
          attribution: '© OpenStreetMap contributors'
        });

        map.addLayer(googleStreet);

Yes when i put map.eachLayer(...) all layers are removed even my google street map

Here is the code for the layers :
`        group_layers = new L.LayerGroup();
    var img_0830_1 = 'data/0830_1.png';
    var img_bounds_0830_1 = [[-20.057853477144814,57.575627574783994],[-20.034769614576177,57.60180083977471]];
    var layer_0830_1 = new L.imageOverlay(img_0830_1, img_bounds_0830_1);
    group_layers.addLayer(layer_0830_1);

    var img_0900_2 = 'data/0900_2.png';
    var img_bounds_0900_2 = [[-20.057853477144814,57.575627574783994],[-20.034769614576177,57.60180083977471]];
    var layer_0900_2 = new L.imageOverlay(img_0900_2, img_bounds_0900_2);
    group_layers.addLayer(layer_0900_2);

     group_layers.addTo(map);

`
I have manged to come across and idea and created a LayerGroup then added all the different layers then at last i've add the layergroup to the map since clearing all the layers remove my basemap as well.
Basemap code:
`        googleStreet = L.tileLayer('https://{s}.tile.openstreetmap.org/{z}/{x}/{y}.png', {
attribution: '© OpenStreetMap contributors'
});
    map.addLayer(googleStreet);`

Then i've called group_layers.clearLayers(): in my method for the timeline
`changeFloodMap = function({label,value,map}){
group_layers.clearLayers();
      if(value == 1){
        map.addLayer(layer_0830_1);
      }
      else if(value == 2){
        map.addLayer(layer_0900_2);
      }
      else if(value == 3){
        map.addLayer(layer_0930_3);
      }
      else if(value == 4){
        map.addLayer(layer_1000_4);
      }
      else if(value == 5){
        map.addLayer(layer_1030_5);
      }
      else if(value == 6){
        map.addLayer(layer_1100_6);
      }
      else if(value == 7){
        map.addLayer(layer_1130_7);
      }
      else if(value == 8){
        map.addLayer(layer_1200_8);
      }
      else if(value == 9){
        map.addLayer(layer_1230_9);
      }
      else if(value == 10){
        map.addLayer(layer_1300_10);
      }

    };
    L.control.timelineSlider({
        timelineItems: ["08 30", "09 00", "09 30", "10 00", "10 30", "11 00", "11 30", "12 00", "12 30" , "13 00"],
        changeMap: changeFloodMap}).addTo(map);`

I can navigate through the layers using the timeline, but i cannot go back, because i think the layers are not being cleared.


⚠ Bofrost.lu has degraded performance

In 8417a12, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 892 ms

Resolved: Bofrost.lu performance has improved in 44becae after 24 minutes.


python3Packages.flask-testing: disable failing tests

Description of changes
Fix build (https://hydra.nixos.org/build/174116993)

update naming
switch to pytestCheckHook
disable on older Python releases

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 170243 run on x86_64-linux 1

7 packages built:

python310Packages.flask-testing
python310Packages.ihatemoney
python310Packages.swspotify
python39Packages.flask-testing
python39Packages.ihatemoney
python39Packages.swspotify
swaglyrics

@ofborg eval

Result of nixpkgs-review pr 170243 run on aarch64-darwin 1

7 packages built:

python310Packages.flask-testing
python310Packages.ihatemoney
python310Packages.swspotify
python39Packages.flask-testing
python39Packages.ihatemoney
python39Packages.swspotify
swaglyrics

The ihatemoney test failures don't look spurious. I need more time to investigate.

Result of nixpkgs-review pr 170243 run on x86_64-linux 1

7 packages built:

python310Packages.flask-testing
python310Packages.ihatemoney
python310Packages.swspotify
python39Packages.flask-testing
python39Packages.ihatemoney
python39Packages.swspotify
swaglyrics


Implement log forwarding using fluent-bit

Is this a BUG REPORT or FEATURE REQUEST?:

Uncomment only one, leave it on its own line:

/kind feature
What happened:
Currently tarmak doesn't have a proper logging solution. While we can deploy a DaemonSet with fluentd and some inner cluster elasticsearch. This solution has a couple of short comings:

No support for kernel, systemd logging
Cluster needs to be up to receive logging
No way to configure logging sinks

What you expected to happen:

I would like tarmak to have one or more logging sinks configured per cluster.
The primarly supported logging sink for now should be elasticsearch.
Fluent-bit is deployed using it's upstream repos and a seperate puppet module
We support elasticsearch IAM auth for AWS, by deploying this proxy
We should not support creating the elasticsearch cluster itself (using terraform within tarmak).

type LoggingSink struct {
  ElasticSearch *LoggingSinkElasticSearch
  Type string // `` empty string matches all, `platform` is kernel, systemd, platform namespaces, `application` is all other namespaces
}

type LoggingSinkElasticSearch struct {
  // options form here: https://fluentbit.io/documentation/0.12/output/elasticsearch.html
  AWSProxy bool
}

/assign @dippynark


near year new readme

I rule and have completed some work on Case Manager that's ready for review!
bumping the readme to remove some OBE sections and update the directions. s/o to the person from december's hacknight who found out the hard way our mongo install docs were out of date.

godmode because readme


New walkthrough UI

Implement new changes based on Figma
And Video: Loom

#120 and #129 demonstration
https://github.com/user-attachments/assets/1996086c-4ec0-4c00-9426-3a1c0a9c2bc1


How to make Tibetan ligatures a larger font size?

Hello,
I'm looking at bookstack for a Tibetan language learning project. One of the features I need to be able to implement is increasing the font size of the Tibetan ligatures in mixed Tibetan/English text blocks. (they are often too small compared to the same font size english text). I am a developer. I'm imagining some filter that scans the document and wraps all groups of Tibetan unicode with spans formatted the way I want. Is this possible in bookstack? What is the best way to go about it?
Another option I'd thought about was using code blocks to mark Tibetan and overriding the styling for code.
Thanks for your time.
Andrew

Hi @moksamedia,
Sorry for my late reply. Interesting requirement you have there.
Had a think, If you don't mind this being done with JavaScript, and you only need this to be active on page viewing (Not edit), You can do this quite quickly with the following:

There's a "Custom Head HTML Content" part of the settings you could add the above to.
Styles are just an example to make changes obvious. The JavaScript, on page load, fetches all main blocks of the page content and then does a rough replacement of the code on each, searching for groups of characters within the tibetan range and wrapping them in span tags with a certain class.
It's fairly sketchy, might need some tuning to not mess with other blocks like code blocks (If used). Could also check for characters within the range and only do a replacement if they exist;  but is a quick way to achieve some sort of desired functionality.

Oh, cool. Thanks for following up.

@moksamedia No worries! I'll therefore close this off, since I can't see there being much chance of others providing further insight since this has been open for a month already.


Upgrade to 1.16

I'd like to use this with the pretrained pyannote, but it uses ONNX ML opset version 4, which isn't supported by 1.14.
I attempted the upgrade naively and got:
   Compiling ortex v0.1.0 (/Users/johndavenport/Documents/github/desktop-example-app-main/deps/ortex/native/ortex)
error[E0432]: unresolved import `ort::tensor::InputTensor`
  --> src/model.rs:19:5
   |
19 |     tensor::InputTensor, LoggingLevel, OrtError,
   |     ^^^^^^^^^^^^^^^^^^^ no `InputTensor` in `tensor`

error[E0432]: unresolved imports `ort::tensor::DynOrtTensor`, `ort::tensor::FromArray`, `ort::tensor::InputTensor`
 --> src/tensor.rs:4:19
  |
4 | use ort::tensor::{DynOrtTensor, FromArray, InputTensor, TensorElementDataType};
  |                   ^^^^^^^^^^^^  ^^^^^^^^^  ^^^^^^^^^^^ no `InputTensor` in `tensor`
  |                   |             |
  |                   |             no `FromArray` in `tensor`
  |                   no `DynOrtTensor` in `tensor`

For more information about this error, try `rustc --explain E0432`.
error: could not compile `ortex` (lib) due to 2 previous errors

Is this trivial for you to do?

Happy to make up a pr for this with some guidance.

There's already a pr for this.

We've updated to 1.19 in main, feel free to open another issue if this doesn't solve your opset version issues


Don't provide autostyle definition if autostyler variable is not defined or if auto style is not enabled...

cc @ivanmalagon

Reopening ticket until it is finally merged.


There appears to be no documentation for a ClaimsTransformation: CopyClaimIfPredicateMatch

One of the scenarios in the custom policy starter pack uses a claims transformation called CopyClaimIfPredicateMatch. I see no documentation about this anywhere. Can we add some documentation about this claims transformation?
https://github.com/Azure-Samples/active-directory-b2c-custom-policy-starterpack/blob/master/scenarios/phone-number-passwordless/Phone_Email_Base.xml#L566

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 9161f948-7c8c-0a57-19ad-1ae731fd65c8
Version Independent ID: 77b6ea7f-e2fe-a7b2-60fa-80b198413ee8
Content: General claims transformation examples for custom policies - Azure AD B2C
Content Source: articles/active-directory-b2c/general-transformations.md
Service: active-directory
Sub-service: b2c
GitHub Login: @msmimart
Microsoft Alias: mimart

@jondmcelroy
Thanks for your feedback! I've assigned this issue to the author who will investigate and update as appropriate.

Thanks for your feedback. I'm adding the claims transformation to the string claims transformation document.


EdcRuntimeExtension: Fixed adding resources to class path (#180)

What this PR changes/adds
resources folder is not added to classpath before test execution of EdcRuntimeExtension. Fixed the path.
Way to test it:
Without the fix, running this command would fail, with the fix it does not fail:
./gradlew clean :system-tests:tests:test

Why it does that
Fix bug #975
Further notes
Linked Issue(s)
Closes #975
Checklist

[ ] added appropriate tests?
[ ] performed checkstyle check locally?
[ ] added/updated copyright headers?
[ ] documented public classes/methods?
[ ] added/updated relevant documentation?
[ ] added relevant details to the changelog? (skip with label no-changelog)
[ ] formatted title correctly? (take a look at the CONTRIBUTING and styleguide for details)

Good catch, at this point you could remove the sanitization quick-and-dirty fix I added at row 170,
since your solution is way better

we still need that fix, since these are different return paths.

the preexisting fix at line 170 is for resolving resource dir in direct dependencies "system-tests/runtimes/file-transfer-provider/build/resources/main"
the new fix is for resolving resource dir in transient dependencies "extensions/in-memory/assetindex-memory/build/libs/assetindex-memory-0.0.1-SNAPSHOT.jar"

@ouphi can you check what failed and if it is not related, I'll merge?

@ouphi can you check what failed and if it is not related, I'll merge?

@jimmarino I triggered the tests again, it is green now.


Add inquirer to CLI tools

Fixes https://github.com/UCL-ARC/python-tooling/issues/431

pre-commit.ci autofix

Does inquirer do progress bars?

Nope - Inquirer focuses on interactive command line interfaces.

This should definitely be squash merged!


Add a deffered creational operator that allows the creation of the actual Stream to be deffered

e.g.
ReactiveSeq.deferred(()->Stream.of(1,2,3))

To be used in situations where the creation of the Stream itself is expensive.

Released in 2.0.0-MI3


Dev/projects api

it's done !!! check it out

i did :)

Added implementation for contributers on projects.

Noticed you're using a different indentation than the rest of the project. It should be 2 spaces indentation project-wide. Everyone should be set up with the same prettier formatting settings, but maybe that wasn't set up properly?

Yeah I noticed that too, lemme look into it.

There is no prettier config file in the repo at all. Without this prettier uses the user's default settings. If you want the consistency then someone needs to add the config file, otherwise you can expect the styles not to match as it's not documented anywhere (at least I couldn't find it)

Yeah, I just added one on my end.
@2nPlusOne is there a doc somewhere that mentions the specific code format? I didn't see a coding format mentioned on the Onboarding Guide or any Contribution section. Might've just missed it though.

Yeah, I just added one on my end. @2nPlusOne is there a doc somewhere that mentions the specific code format? I didn't see a coding format mentioned on the Onboarding Guide or any Contribution section. Might've just missed it though.

Not your fault! You're absolutely right, there isn't one. This is definitely something we should fix. I created a ticket for this. Feel free to edit it (either of you) with your additional thoughts.

Thanks!


Add example simulation

Example simulation to serve as focal point for design discussions...

Coverage remained the same at 74.107% when pulling 25e9bf591b1088e9416d0d1bb31349a49cbbd9e6 on add-example-simulation into a446f4584cb190880f4fec9985d901332ef99ab4 on develop.


tt_lib.tensor.bmm and matmul - inconsistent documentation

For tt_lib.tensor.bmm and tt_lib.tensor.matmul ops:
The documentation does not state that operands need to be on device. But when operation is run with inputs in system memory we get error:
input_tensor_a.storage_type() == StorageType::DEVICE and input_tensor_b.storage_type() == StorageType::DEVICE
info:
Operands to matmul need to be on device!

tt_lib bmm/matmul no longer exist and everything in python goes through ttnn matmul/linear. I updated the documentation for the latter to indicate that the tensors need to be on the device.


Details of codeforces generated tests

3.2.1. of the arxiv version of the paper, page 8 mentions that the Codeforces generated tests are produced through a complex procedure based on mutating inputs and verifying agreement of correct solutions. Is there any plan to release the code for this generation procedure? Replication and extension of the codeforces portion of the code contests dataset might require the application of this process to more recent problems.
Thanks!

We don't have plans to release the code for the generated tests. The overall idea is to replace random subset of pre-existing inputs with similar elements (strings with strings, numbers with numbers), then run code solutions that are known to be good, and seeing if there is consensus in the outputs for the same input, if there is consensus then we regard that (input, output) pair as a generated test. You can use any method to generate the inputs. Usually the challenge is filtering the "inputs" that are actually invalid for the problem, and for this we run the correct code solutions, but you can use any method for this for example manual checking.


Add a go worker

What does this PR do?

Motivation

Additional Notes

Review checklist (to be filled by reviewers)

[ ] Feature or bugfix MUST have appropriate tests (unit, integration, e2e)
[ ] PR title must be written as a CHANGELOG entry (see why)
[ ] Files changes must correspond to the primary purpose of the PR as described in the title (small unrelated changes should have their own PR)
[ ] PR must have changelog/ and integration/ labels attached
[ ] If the PR doesn't need to be tested during QA, please add a qa/skip-qa label.

Current dependencies on/for this PR:

master

PR #13807

PR #13808

PR #13809   👈

PR #13810

This comment was auto-generated by Graphite.

Closed in favour of https://github.com/DataDog/integrations-core/pull/13808


Removing broken/template cookbooks from gallery

Now that we have a few cookbooks that mostly work (CESM LENS on AWS, CMIP6, HRRR AWS, and Radar), should we remove the entries that are currently only the template material (Packaging, XGCM) or broken (Physical Oceanography)? Maybe also the Matplotlib Colorbars cookbook, depending on overlap with this recent merge in Foundations.

I would opine that we either do not show cookbooks in the gallery that are known to be broken until we can fix them, or make use of the health check ("nightly-build") flag to indicate that they are broken in some way (but may still be useful to view).

I think we can differentiate between cookbooks that are "broken but partially useful" and ones that really have no content. I opine that the ones that have no actual content beyond the template material (even if they have some work-in-progress stuff in open PRs) should not appear in our gallery.
So yes, I opine that we should remove Packaging and XGCM cookbooks from the gallery for now and add them back in when they have some content merged in.
Related points in #41: we should have tagged releases of Cookbook source repos to coincide with the decision to "include them in the gallery"
and in https://github.com/ProjectPythiaCookbooks/cookbook-template/issues/53: our health checks need a more nuanced way to report failures in notebook execution.

Done with #84


BlobClient.query_blob(...)  & BlockBlobClient.Query(...) result in "Bad Request"

Which service(blob, file, queue, table) does this issue concern?
blob
Which version of the Azurite was used?
17.1
Where do you get Azurite? (npm, DockerHub, NuGet, Visual Studio Code Extension)
tried both Visual Studio 2022 & npm
What's the Node.js version?
16.15.1
What problem was encountered?
When querying a blob, you get a "bad request" from Azurite, in Python:
blobClient.query_blob("SELECT * FROM BlobStorage")
In C#:
blockBlobClient.Query("SELECT * FROM BlobStorage");
I tried this in both Python and in C#, with different .csv files including one from https://www.stats.govt.nz/large-datasets/csv-files-for-download/
Steps to reproduce the issue?
I can provide full (Python/C#) +data code that reproduces this problem. For me it happened with every possible way in creating a blobClient and executing query_blob.
Have you found a mitigation/solution?
No.

@DonnyWhoLovedBowling
Blob Query is still not supported by Azurite, see https://github.com/Azure/Azurite#support-matrix

Oh, thanks for pointing this out! I searched the whole Internet for
something like this,  but somehow overlooked this matrix.
Op do 9 jun. 2022 18:16 schreef Wei Wei @.***>:

@DonnyWhoLovedBowling https://github.com/DonnyWhoLovedBowling
Blob Query is still not supported by Azurite, see
https://github.com/Azure/Azurite#support-matrix
—
Reply to this email directly, view it on GitHub
https://github.com/Azure/Azurite/issues/1535#issuecomment-1151337560,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADBK7JSCTHEYT55VVVYQOADVOIKGPANCNFSM5YKM2QXQ
.
You are receiving this because you were mentioned.Message ID:
@.***>


CC177472, Adding missing breakline

This proposed file change comes from https://github.com/dotnet/docs.zh-cn/pull/508/files.
Description: Missing breaklin for link

Hi @mairaw, @tdykstra , @BillWagner, can you please help by merging this PR?
Thanks in advance.

@v-maudel On second thought, I think the lack of a line break was intentional.

Thanks @tdykstra, I will notice the contributor that this link should remain in the same line and it's not a separated item.


Note that Java version must be <= 9

Examples don't work with Java 10 due to ... reasons.
Related:
https://github.com/cockroachdb/docs/issues/3164
tl;dr from above: Suggestion was to downgrade to 9 as 10 is breaking lots of code due to the introduction of "modules" in v10.
I think we should reassess updating the examples once Java 10/11 are more widespread (?).  Hopefully adding these notes will help at least some users avoid a frustrating experience until then.

This change is

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/2b5c771fe8cd9b33504cae33578ffe981922926f/

Thanks. I think the examples mostly work with Java 10. There's just something wrong with our dependency setup. If people use the examples as a code reference, things should still work - but I agree we should revisit this as Java 10 gets more popular.

@jordanlewis sorry, I just want to make sure I understand: do you think we should re-word this note to say something about Java 10 dependency mgmt?  Or keep it roughly as is, for now?

Happy to see it kept as-is - that was just a note for you.

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/d3030000b743176fa41f79f829f848d7d5f7c8b6/


Add Dataclasses

With the release of Python 3.7, dataclasses have been added to the language.
Would be useful for some of the elements we manage, like how we're building a card from the ground up. I have no problem advancing this project to 3.7-Minimum, if we can incorporate this into the project.

Not sure if it's necessary...


The built-in checkbox column filter stopped working after upgrading to v1.2.0

I used the built-in checkbox column filter as described in the example here: advanced filters example
With v1.0.3 everything worked well but when I upgraded to v1.2.0 the checkbox filter stopped working.

What is your code?
I'm using 1.2.1 and checkbox filter works well..

Code example:
 columns: { isActive: {         title: 'Active',         type: 'custom',         renderComponent: BooleanCellComponent,         filter: {           type: 'checkbox',           config: {             true: true,             false: false,             resetText: 'clear',           },         }       } }
I used the checkbox filter a couple of times for boolean values.

Try this:
filter: {type: 'checkbox', config: {true: 'true', false: 'false'}}

Also in PR #427 I've inserted support for checkbox render type, so you could use it instead of
type: custom with renderComponent

@NordRagnarok Thanks, it's working 👍


Noise sims in CAR and noise splits

This is work in progress towards

noise sims in CAR, fixes https://github.com/simonsobs/map_based_simulations/issues/28
noise splits, fixes https://github.com/simonsobs/map_based_simulations/issues/30

Current changes include:

API Change to SONoiseSimulator and restructuring so that only LAT is initialized by default
Accepts shape,wcs pixell parameters for geometry
Looks for saved noise template with nearest resolution and interpolates only if necessary
Uses pixell.curvedsky.rand_map instead of synfast when not healpix
Some docstring fixes
Added nsplits option which just multiplies the noise power by nsplits and appends as many copies of simulated noise maps
Added noise template generation script to repo
Serve noise templates on http and download when installing
Default mask value is nan for CAR; but allows mask value to be overridden for both healpix and CAR

To do:

Standardize resolution/WCS choices with mapmaker/TOD codes

E.g. invocation:
bounds_deg = [-80.,40.]
res_arcmin = 2.0
shape,wcs = enmap.band_geometry(np.deg2rad(bounds_deg),res=np.deg2rad(res_arcmin/60.),proj='car')

nsim = mapsims.SONoiseSimulator(
        shape=shape,
        wcs=wcs)

ch = mapsims.SOChannel("LA", 145)
omap = nsim.simulate(ch, output_units="uK_CMB", seed=None)

Output:

@zonca This is ready to be merged once the requirements.txt issue #30 is solved. I will raise a separate issue for this to-do item: "Standardize resolution/WCS choices with mapmaker/TOD codes".

fixed in #32 and extra commits to master to fix readthedocs, can you rebase?

Done.

@msyriac can you fix the errors on travis?
consider also that NERSC /project is down until 1pm PST today, so that could cause some tests to fail.

I can't even run the tests locally, since the test suite requires pytest-astropy which requires psutil which it doesn't seem can be compiled using Intel compilers. https://github.com/giampaolo/psutil/issues/1664

@msyriac can you just try to fix the variable undefined issue? I can then later pickup from there


Update master from develop after Salt 2016.11.4 release

Updated master from Salt 2016.11.4 release and update nightly build branch 2016.11


Is this application compatible with Raspberry Pi 3 Model B?

I just got a Raspberry Pi 3 Model B. I don't know how to run or configure the web side part. When I open the web page through Index.html file only the title appears nothing else. I will appreciate any help. Thanks.

It works with Pi 3. If you follow the installation instructions and you must edit config.json especially with this new version. change use_openhab to false, if you want to protect the site from anyone being able to open and close your garage door set use_auth to true then change usename and password, next set use_alerts to true if you want notification if you left garage door open,  set alerts = "smtp" I use smtp and use my phone number as the to-address. I created a simple gmail acct as you will be exposing username and password in this file. You will only see the door list if the program is running properly, that's why you see only title., I also use different GPIO pins and only have one garage door so i change that. See my example
config_json_sample.pdf

Hi,
I'm also trying to set this up on a RPi3 and am having some difficulties.  I am a total newbie to everything in this so please bear with me.  So far everything seems to be working except when i pull up the website it doesn't show any buttons. Just "My Garage" banner across the top.  Is My config file in the wrong place? or do i need to point something to it?
Thanks.

"So far everything seems to be working " why do you think that. navigate to garage-controller-door folder
type command python controller.py   and see if there are any errors. Did you review the config.json file I posted above. The website will display even if the python script is not running.

Thank you for the quick reply.  I guess what i meant was that the apache server seems to be working as i can open the "My Garage" page from outside my home.  When i type command python controller. py it just moves the cursor to the next line and does nothing else.

pi@raspberrypi:~/¬pi/garage-door-controller $ python controller.py
Traceback (most recent call last):
File "controller.py", line 332, in
controller.run()
File "controller.py", line 212, in run
reactor.listenTCP(self.config['site']['port'], site)  # @UndefinedVariable
File "/usr/lib/python2.7/dist-packages/twisted/internet/posixbase.py", line 495, in listenTCP
p.startListening()
File "/usr/lib/python2.7/dist-packages/twisted/internet/tcp.py", line 979, in startListening
raise CannotListenError(self.interface, self.port, le)
twisted.internet.error.CannotListenError: Couldn't listen on any:8081: [Errno 98] Address already in use.
So i tried to just redo the whole thing and this is what i got

well when you typed command and cursor moved to next line that was a good thing, means the program was started, then you should have attempted to use a browser to check your website. in the first case it would appear you had not created a startup entry to get the script running on reboot.
However in the second post seems your error is a result of a conflict of ports so change the port in config.json to some other value like 8085.


Bump bundler plugins to latest

We should also bump the bundler plugins, e.g. @sentry/vite-plugin or @sentry/webpack-plugin, to the latest version - as older versions may not play well with v8.

This is already handled by https://github.com/getsentry/sentry-migr8/blob/fe5d4a3ff1ee3a1d861472d689e28a4f11f6b209/src/transformers/sdkLatestVersion/index.js#L33


align loadtoast

Hi,
thank you for this library. this is very good
I have a problem. when I am testing loadtoast on android 4.4 it is showing in center&top of screen but on android 4.0, its align is right&top of screen. I want loadtoast be center&top always. also some time in android 4.4 showing in right&top
how can i fix this problem?

Would be helpful if you could provide some sample code so I can recreate this myself.

I found the problem :+1:
I am using LoadToast in a fragment. I was creating an instance of this class in onActivityCreated method in fragment and some time the align of loadToast was right&top. I don't know was actually happen but now I am creating that instance when i need (after click a button) and align of loadToast is center&top
thank you very much :-)

Thanks, I'm going to check if I can do something so it does align properly when you init it in onActivityCreated.


Cannot import orchid into Jupyter notebooks after Orchid 2022.1.360

Given I have created a virtual environment for Orchid
And I configure it to use an Orchid version after 2022.1.360
When I execute jupyter lab in the created virtual environment
And I open an example notebook
And execute a cell containing the statement, import orchid
Then the Jupyter kernel restarts
And the logged data shows the exception
"""
Unhandled Exception: System.InvalidOperationException: Failed to compare two elements in the array. ---> System.IO.FileNotFoundException: Could not load file or assembly 'Microsoft.Extensions.Logging.Abstractions, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=adb9793829ddae60' or one of its dependencies. The system cannot find the file specified.
"""
But no error occurs if run from Python directly

Here's the details for the assembly in 2022.1.360:

This issue is no longer reproducible after package updates to Orchid.


Fetch user appliance description from the API

We can fetch the user appliance description from the API. It contains a lot of specific device info like a model, brand, or serial number. It contains also the name under which it was configured in the HomeWhiz app. we could use this as a device name in HA instead of the ugly HwZ_fb032dd767002b071c
@TechHummel This is the last thing I would like to implement before releasing a new version

I was just about to ask you about your opinion on a new tagged version 😂

I'm also eagerly waiting for the PR to HACS default repo :)
Maybe someday this integration will become an official HA component
Can you test the newest version on your machine?
Also, I can't thank you enough for all the work you've put into this project <3

I hope I'll be able to test end of next week!
Adding an integration officially can be a lot of work. I tried that a while ago but didn't want to publish my code additionally as a python module on pypi. However, I'd be interested in going through the process again and actually succeed! 😁
Hardly any work compared to you! I actually wish I could be of more assistance and contribute actual code - hopefully soon!


Parsing days in timestamp fails in notation cert generate-test -e

$ notation cert generate-test -e 12d
Incorrect Usage: invalid value "12d" for flag -e: parse error

Since the -h page gives --expiry value, -e value  certificate expiry (default: 8760h0m0s), I expected it to be able to parse "d" as days. Perhaps clarify the allowed format in the help?

Thanks @nelson-wu. @shizhMSFT, what do you think?  Any PRs are welcome to fix

The expiry value is parsed into time.Duration by the built-in method time.ParseDuration() and it does not support days.

Closed Duplicate issue: https://github.com/notaryproject/notation/issues/423
    With  the current implementation, we yet don't support `d` (e.g. `30d` ).

Originally posted by @shizhMSFT in https://github.com/notaryproject/notation/pull/417#discussion_r1009073464
notation sign command supports an optional expiry flag for user to specify a "best by use" time for the artifact. The duration can be specified in minutes(m) or/and hours(h). The intention of this issue is to support duration in days, for example, 30d, 1d3h20m.

Close this issue as notation cert generate-test doesn't support --expire flag. Please create a new issue to request this feature if needed


Issue with template application

Hi! After playing around with aizynthfinder, I have detected some issues regarding the application of the reaction templates, mainly among those defined as "selective" in your publication "Datasets and their influence on the development of computer assisted synthesis planning tools in the pharmaceutical domain"
Within the cases identified so far, two main classes are predominant:

Intramolecular reactions for which the application of the corresponding template may define a two-component reaction.
Reactions for which the forward application of the corresponding template is not able to regenerate the desired product.

Apparently, aizynthfinder does not check these specific cases in a forward manner to ensure product regeneration and keep consistency in the number of components.
For the sake of clarity, I'm attaching a jupyter notebook including a couple of examples:
WrongRXNtemplates.pdf
Thanks, David.

Hi David,
Thanks for your comments. In the publication you have referred to we did not test the application of the templates in the "forward" direction. The templates were only tested in the "reverse" or retrosynthetic direction as our goal was to determine whether the reactants could be re-generated by applying the template to the product recorded in the dataset. The selective criteria is in reference to the aforementioned test and does not hold true for the forward direction as this was not tested.
Perhaps @SGenheden has noticed similar issues as he has been applying the templates in the forward direction.
A second point to note in the Jupyter notebook you have attached is that we use RdChiral to apply the templates. The functions implemented in RdChiral are built upon the RdKit functionality however include additional consistency checks. We use RdChiral as we had previously experienced issues when using RdKit Run Reactants.
Kind Regards,
Amol

Hi Amol,
Thanks for your prompt response. I'm well aware you're using rdchiral, I just used rdkit to showcase these examples in a straightforward manner. Please, bear in mind that it's not that I've been testing these reaction templates separately, I detected all these issues when reviewing different synthetic routes proposed by aizynthfinder itself. In my opinion, this is a major issue that clearly limits the practical use of aizynthfinder in a production setup, but I think it wouldn't be that difficult for someone with a clear knowledge of the code to patch it, that's why I decided to report it.
My question then would be, are you going to implement a solution to this issue in the short term?
Thanks again,
David

On one side: the filters suggested would be straightforward to implement within the "generalized filter" framework introduced in version 3.0.0 of the code.
On the other side: while thinking about the implementation and doing something testing, I have more objections/worries that you might be able to straighten out:

For the intramolecular reaction, your suggestion to check the number of fragments defined in the template sounds alright in principle, but practically it is harder to implement. There is a property in RDKit that I can query to find out the number of fragments (GetNumProductTemplates), however finding out if this agree with the generated reactants are harder. RDChiral returns a SMILES string, where molecules are separated by the usual ".". However, there is nothing to tell if this is an intramolecular or intermolecular bond. In your provided example, the situation the check works, because the correct solution is only a single molecule (I assume the second intramolecular fragment is removed by RDChiral). But I don't know if it is general feature that one of the intramolecule fragments will be "disappear".

For the forward generation filter, my question is more what to do if the forward template generate more than one product. Is it sufficient to check that one of the products is the correct one?

Also: in your example, the reactants generated by vanilla RDKit and RDChiral does not agree. For the reactant where you cannot regenerate the product with the forward template, RDChiral only gives one reactant - so the check is even more straightforward.
Finally: can you elaborate on your statement "in this case, it's not a matter of chemical feasibility of the proposed reaction schema, which could be eventually successful, the problem here is that the route proposed by aizynthfinder leads to a different molecule to the one used as target. " I don't follow.
I will implement the filters to the best of my capability and run some large scale testing. And if we can sort out the question marks above and I am satisfied with the filters I will provide a PR for you to review.

Addition to the forward generation filter: I get a lot of these kind of rejections.
Template: ([C:3]-[O;H0;D2;+0:1]-[c:2])>>([OH;D1;+0:1]-[c:2])

Product: CC(C)(C)OC(=O)N1C(=O)NC(=O)C1(C)c1ccc(OC(F)F)cc1

giving this reactant:

The flourine atoms on the product is removed in the process, and they can naturally not be recreated from the template, and hence the forward generation fails.
This kind of situation seems to be rather common (I have so-far got ~1,000 rejections on ~30 molecules).
What to do about these kind of situations?

Hi Samuel,
The forward filter will understandably not work in this case as the template does not allow for recreation of the flourine atoms. If the template you show is the one that was extracted from the reaction in the dataset then the problem is in the template extraction, and is to do with the generality.
As we only extracted templates with a radius of one, that means as the change is occurring on the oxygen atom then we extract only the environment one bond away. One solution to the problem which takes into account the flourine atoms is to encode the diflouro group as a special group. However, doing this for every functional group is quite tedious. We have already encoded approximately 75 protecting and functional groups to try and deal with similar issues, however they may still pop up every now and then due to how we wrote the SMARTS to detect the groups.
To solve the issue properly would require iterating on the template extraction algorithm in my opinion as i don't see a long term fix in post-processing unless an approach was used that does not require use of the template for validation.
This issue can also be seen as once of the drawbacks of the template based approach or at least the automatic extraction process whereby logic is not present for all situations that may be encountered.
Amol

Hi both and thanks again!
Well, it looks like things aren't always as straight forward as they should be. Yes, protection and deprotections can be a problem as the reactions are not completely defined in the raw reaction data with the protection reagents or leaving groups usually not reported. In these cases forward target regeneration will be obviously impossible, and this clearly limits the generalization of the additional regeneration step as a security check. To be honest, I do not have any further suggestion about what should be done. Perhaps @A-Thakkar is right and this is an intrinsic limitation of the template-based approach; if raw reaction data is not complete neither will be the extracted templates.
On the other hand, @SGenheden, I have checked it and you're right, there is a discrepancy this time between the reactants generated by RDkit and RDchiral for the 2nd example (although the originally reported disconnections were also observed in previous aizynthfinder tests):

Very surprisingly the wrong disconnection is not observed in this case and, moreover, the newest one defines an intramolecular reaction (see screenshot above) which, on the paper, makes a lot of sense. In this case, we were expecting a 1product>2reactants schema and the template identified a 1product>1reactant one, which again put us in the corner if we intend to use a consistency filter for the number of reactants defined in the template.
The only thing we can do in the later case, if we want to solve the issue with the intermolecular reaction found in the first example (Bischler-Napieralski), is to apply the following filter:
      Number reactants (template) ≥ Number reactants (disconnection)

And that woud work for the two cases previously discussed:
Bischler-Napieralski

Bromo N-Alkylation

Would that make sense to you?
Cheers,
David

Hi Samuel,
I'm not a synthetic chemist either, but from my perspective the rejection of the first example is correct. In the training set, the cyclisation is occurring because the relative position of the hydroxyl and the aromatic ring in the same reactant (+ the additional C=O) allows the intramolecular formation of a 6-membered ring. However, that's not the case in the rejected example where there is no ring formation. Another discussion is whether a radius of one is enough to extract templates describing intramolecular cyclisations like this one, but this I guess is a completely different story.
The second template describes the reaction between a double alkylating agent and an amine. So, at least formally, the first example should be rejected (Ntemplate<Ndisconnection) and the second one accepted (Ntemplate>Ndisconnection). In this specific case, though, I think that the rejected reaction is actually feasible and it would be most probably recovered as a two consecutive Bromo N-alkylation steps.
Thus, I think, the inequality check is working as expected and with a limited overhead time. If I had to make a decision, I'd definitely implement it.
Thanks for your time and patience.
Cheers,
David

Hi @SGenheden, I see that commit merge is still pending, is there anything else you'd like to discuss?

Hello @dvidmon,
I think I partly forgot about it :-) and partly I was waiting for you to comment/test the PR.
If you don't think it needs to be modified, I can merge the PR and close this issue.

Hi Samuel!
Ok, thanks, I didn't know what to do next, I guess I'm not that used to open issues on GitHub :) Please, proceed with the merging, I think you already tested it more extensively that I possibly could.
Again, thanks a lot for your help. I'm planning to run AiZinthFinder during the following weeks, in the unlikely event of more issues I'd contact you again :)
Cheers,
David


Bug: QA Data Appendix E Correlation Heat Input

Issue:
Appendix E Correlation Heat Input from Gas and Appendix E Correlation Heat Input from Oil Add/Edit modal does not populate Monitoring System ID - hence the screen does not allow to add/edit a record.

Am able to Add and edit 'Appendix E Correlation Heat Input from Gas'. Am unable to test Oil due to a but. This will be tested in future ticket related to the fixing of the Oil bug


Users can choose to view scripture from tC projects uploaded to DCS

Currently, gE scripture cards can show USFM files from Book Package Repos.  The user enters the URL for the repo and gE displays the currently selected book in the scripture card.
Additionally, users should be allowed to enter the address of a tC project that has been uploaded to DCS in order to view the scripture from that project in gE, if the project contains the matching book to what is selected in the reference bar. If the book of the Bible in the project does not match the selected book in gE, then the scripture card will show the standard message when data is unavailable.  Sample repo: https://git.door43.org/birch/en_kjv_eph_book/src/branch/master
DoD:
Entering the top-level DCS URL for a tC project in the scripture picker will allow the user to view the scripture from that project in the scripture card.
Details:
@PhotoNomad0 notes that we already have a way to know if a repo is a tC project.  The USFM  file with alignment data is stored in the root directory of the project repo.

Below is a re-write of the conditions stated above:
Currently, gE scripture cards can show USFM files from Book Package Repos.
The user enters the URL for the repo and gE displays the currently selected book in the scripture card.

if the book matches the book in the project: the card loads the resource
If the book  does not match: then the scripture card will show the standard message when data is unavailable.

@birchamp In short, is the goal to make the following work?

Yes @theNerd247  that's correct

@birchamp A tCore project will also have to be read-only - otherwise there could be a big mess.

@birchamp @theNerd247 We should probably meet with @richmahn to talk through the best way to determine if it is a tCore project.  Note in the example given there are two USFM files in the root folder.  The one to use is en_kjv_eph_book.usfm, which follows the same naming convention as the repo name.  But we probably should use the manifest file to determine that it is a tCore project.

I agree. The manifest seems like the best place since we’re already grabbing that and parsing it for meta data (for translation notes, etc.)

On Sep 11, 2023, at 8:12 AM, Bruce McLean @.***> wrote:
@birchamp https://github.com/birchamp @theNerd247 https://github.com/theNerd247 We should probably meet with @richmahn https://github.com/richmahn to talk through the best way to determine if it is a tCore project. Note in the example given there are two USFM files in the root folder. The one to use is en_kjv_eph_book.usfm, which follows the same naming convention as the repo name. But we probably should use the manifest file to determine that it is a tCore project.
—
Reply to this email directly, view it on GitHub https://github.com/unfoldingWord/gateway-edit/issues/342#issuecomment-1713757488, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAG6ND5GUADE6H6TCQW242LXZ354XANCNFSM53WYSXJQ.
You are receiving this because you were mentioned.

@PhotoNomad0 @birchamp Are there naming standards for scripture resources? The reason this bug exists is:

the URL parser that gateway-edit is using is not parsing the repo name correctly
the manifest file being fetched is a manifest.yaml

This is what works:    https://git.door43.org/api/v1/repos/birch/en_kjv_eph_book/contents/manifest.json?ref=master
GE looks for the this: https://git.door43.org/api/v1/repos/birch/en_kjv                  /contents/manifest.yaml?ref=master

The parser for the url is found at: single-scripture-rcl. I'm not sure if fixing the parser
is the correct approach here or if the repo given above should have its name changed. @birchamp I looked through the
git log and noticed that the repo you gave was ported from some legacy system.

Are there still legacy artifacts left behind that need to be cleaned up?
Are there other repos that act as an example tC projects uploaded to DCS?

Do we have documented a place where tC encodes its info and where gE decodes?

@theNerd247 @birchamp I checked into the specs for the tC manifest.json and discovered that there is none recorded.  The plan was to transition from the manifest.json in tC to the resource container format in http://resource-container.readthedocs.io/en/v0.2/manifest.html .  But that never happened.  We started off with the manifest.json of translationStudio (see https://ts-info.readthedocs.io/en/latest/manifest.html?highlight=manifest).  But the format changes were not documented - just codified.
That being said.  There really isn't much point in looking in the manifest.json anyway - there is no reference to the contained usfm that matches the tCore repo name (e.g.)
Here is the naming spec for repos on Door43: https://git.door43.org/unfoldingWord/registry
Suggestions for url validations going forward:

if the user enters an url that points directly to a usfm file, then we check if the usfm file exists.  If so we will use it. (this behavior is the same as tCore)
when user enters an url that points to a repo and that repo does not contain a manifest.yaml then we check if the repo contains a usfm file that matches the repo name.  If so we will use the URL that points to the usfm file itself.

Then at GWE run-time when we see that the user selected an usfm url:

if it is not loadable we show the usual "content is not found" message.
and since the USFM is the wild west, we should check the header to make sure there at least is an \id field with a valid book code.

then in GWE we only show the content when they have navigated to the book that matches the id in the usfm file.

Hey @PhotoNomad0! Thanks for finding this. Let me dig through the code for single-scripture-rcl to see what it would take to make these changes.

On Sep 13, 2023, at 3:40 PM, Bruce McLean @.***> wrote:
@theNerd247 https://github.com/theNerd247 @birchamp https://github.com/birchamp I checked into the specs for the tC manifest.json and discovered that there is none recorded. The plan was to transition from the manifest.json in tC to the resource container format in http://resource-container.readthedocs.io/en/v0.2/manifest.html . But that never happened. We started off with the manifest.json of translationStudio (see https://ts-info.readthedocs.io/en/latest/manifest.html?highlight=manifest). But the format changes were not documented - just codified.
That being said. There really isn't much point in looking in the manifest.json anyway - there is no reference to the contained usfm that matches the tCore repo name (e.g.)
Here is the naming spec for repos on Door43: https://git.door43.org/unfoldingWord/registry
Suggestions for url validations going forward:
if the user enters an url that points directly to a usfm file, then we check if the usfm file exists. If so we will use it. (this behavior is the same as tCore)
when user enters an url that points to a repo and that repo does not contain a manifest.yaml then we check if the repo contains a usfm file that matches the repo name. If so we will use the URL that points to the usfm file itself.
Then at GWE run-time when we see that the user selected an usfm url:
if it is not loadable we show the usual "content is not found" message.
and since the USFM is the wild west, we should check the header to make sure there at least is an \id field with a valid book code.
then in GWE we only show the content when they have navigated to the book that matches the id in the usfm file.
—
Reply to this email directly, view it on GitHub https://github.com/unfoldingWord/gateway-edit/issues/342#issuecomment-1718213017, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAG6ND3BJJZSN4WPUO7PQLLX2ID23ANCNFSM53WYSXJQ.
You are receiving this because you were mentioned.

I talked to Benjamin from the content team today about the need for importing from repos created in tCore. He's not aware of any immediate need for it but has started a thread with the content team on Zulip.
@birchamp Could you give more insight to why this feature is needed? I'd like to understand that first before starting the work on backwards compatibility (per @PhotoNomad0's comment above)

After having more dialog with the content team I am discovering that the "real" issue is the synchronization of work between tC and gateway-edit in git. The mechanisms used by tCore are potentially outdated? I'm aware that this issue has a larger history that I'm not aware of and it seems that this issue is either a small "hack" to resolve a pressing problem or a small step towards migrating users away from tCore.
I'm wondering if it would be worth having a discussion about which features our users are still using in tCore and if we might better spend our time porting those features over to gateway edit. Some of these features includes:

offline editing
modifying documents that are not merely scripture (such as OBS stories - see #497)
viewing n >= 3 versions of a given text

@birchamp Could you provide some direction regarding this?

@theNerd247 It was in a content meeting they said that when someone makes changes in tC it would be good to be able to see them in gE. But I'm wondering if as soon as gE gets scripture merging if this will be needed at all. I looked through the chat on Zulip and I think that the same thing applies we need to get editing and merging working and then see if they still want the feature.

@theNerd247 I'm deprioritizing this for now.

Notes:

tCore book repos:

use manifest.json (not yaml)
only have a single book of the bible
repo naming convention is en_kjv_eph_book

whereas - scripture-resource-rcl is hard coded to load scripture repos that

have a manifest.yaml,
use the bible naming convention (e.g. en_ult)
support multiple bible books (called projects in manifest).

@PhotoNomad0  the metadataType property of an API repo or catalog entry object will tell you what it is: rc, tc, sb or ts

metadataVersion also may help

@birchamp @theNerd247 We should probably meet with @richmahn to talk through the best way to determine if it is a tCore project. Note in the example given there are two USFM files in the root folder. The one to use is en_kjv_eph_book.usfm, which follows the same naming convention as the repo name. But we probably should use the manifest file to determine that it is a tCore project.

DCS determines metadataType by unmarshalling the manifest or metadata file into various Go structs. When it get one that matches, it knows metadata type and vision and gives that to you from the API.

Make sure to also query the repos available with metadataType= (multiple are ordered) for what your app supports.
https://git.door43.org/api/v1/repos/search?metadataType=rc&metadataType=tc etc.


HomeAssistant crash - ValueError: bad marshal data

Home Assistant release with the issue:
~ $ hassio info
arch: armv7
channel: stable
hassos: "3.7"
homeassistant: 0.103.5
hostname: hassio
logging: info
machine: raspberrypi3
supervisor: "193"
supported_arch:
- armv7
- armhf
timezone: Europe/Brussels

Operating environment (HassOS/Generic):
HassOS
Supervisor logs:
hassio supervisor logs
20-01-05 10:31:27 INFO (MainThread) [__main__] Initialize Hass.io setup
20-01-05 10:31:28 INFO (SyncWorker_0) [hassio.docker.supervisor] Attach to Supervisor homeassistant/armv7-hassio-supervisor with version 193
20-01-05 10:31:28 INFO (MainThread) [__main__] Setup HassIO
20-01-05 10:31:28 INFO (MainThread) [hassio.utils.gdbus] Connect to dbus: org.freedesktop.systemd1 - /org/freedesktop/systemd1
20-01-05 10:31:29 INFO (MainThread) [hassio.utils.gdbus] Connect to dbus: org.freedesktop.hostname1 - /org/freedesktop/hostname1
20-01-05 10:31:29 INFO (MainThread) [hassio.utils.gdbus] Connect to dbus: de.pengutronix.rauc - /
20-01-05 10:31:29 INFO (MainThread) [hassio.utils.gdbus] Connect to dbus: org.freedesktop.NetworkManager - /org/freedesktop/NetworkManager/DnsManager
20-01-05 10:31:29 INFO (MainThread) [hassio.host.info] Update local host information
20-01-05 10:31:29 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.DBus.Properties.GetAll on /org/freedesktop/hostname1
20-01-05 10:31:29 INFO (MainThread) [hassio.host.services] Update service information
20-01-05 10:31:29 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.systemd1.Manager.ListUnits on /org/freedesktop/systemd1
20-01-05 10:31:29 INFO (MainThread) [hassio.host.network] Update local network DNS information
20-01-05 10:31:29 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.DBus.Properties.GetAll on /org/freedesktop/NetworkManager/DnsManager
20-01-05 10:31:29 INFO (MainThread) [hassio.host.apparmor] Load AppArmor Profiles: {'hassio-supervisor'}
20-01-05 10:31:29 INFO (MainThread) [hassio.host.services] Reload local service hassos-apparmor.service
20-01-05 10:31:29 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.systemd1.Manager.ReloadOrRestartUnit on /org/freedesktop/systemd1
20-01-05 10:31:29 INFO (SyncWorker_2) [hassio.docker.interface] Attach to homeassistant/armv7-hassio-dns with version 1
20-01-05 10:31:29 INFO (MainThread) [hassio.dns] Update resolv from Supervisor
20-01-05 10:31:29 WARNING (MainThread) [hassio.dns] Ignore invalid DNS Server: dns://2a02:1800:100::45:2
20-01-05 10:31:29 WARNING (MainThread) [hassio.dns] Ignore invalid DNS Server: dns://2a02:1800:100::45:1
20-01-05 10:31:29 INFO (MainThread) [hassio.dns] Start CoreDNS plugin
20-01-05 10:31:29 INFO (MainThread) [hassio.misc.forwarder] Start DNS port forwarding to <IP_ADDRESS>
20-01-05 10:31:29 INFO (SyncWorker_2) [hassio.docker.interface] Clean hassio_dns application
20-01-05 10:31:54 INFO (SyncWorker_2) [hassio.docker.dns] Start DNS homeassistant/armv7-hassio-dns with version 1
20-01-05 10:31:54 INFO (SyncWorker_3) [hassio.docker.interface] Attach to homeassistant/raspberrypi3-homeassistant with version 0.103.5
20-01-05 10:31:55 INFO (MainThread) [hassio.hassos] Detect HassOS 3.7 on host system
20-01-05 10:31:55 INFO (SyncWorker_1) [hassio.docker.hassos_cli] Found HassOS CLI homeassistant/armv7-hassio-cli with version 15
20-01-05 10:31:56 INFO (MainThread) [hassio.store.git] Load add-on /data/addons/git/a0d7b954 repository
20-01-05 10:31:56 INFO (MainThread) [hassio.store.git] Load add-on /data/addons/core repository
20-01-05 10:31:57 INFO (MainThread) [hassio.store] Load add-ons from store: 62 all - 62 new - 0 remove
20-01-05 10:31:57 INFO (MainThread) [hassio.addons] Found 5 installed add-ons
20-01-05 10:31:57 INFO (SyncWorker_4) [hassio.docker.interface] Attach to homeassistant/armv7-addon-check_config with version 3.1
20-01-05 10:31:57 INFO (SyncWorker_1) [hassio.docker.interface] Attach to homeassistant/armv7-addon-duckdns with version 1.10
20-01-05 10:31:57 INFO (SyncWorker_8) [hassio.docker.interface] Attach to homeassistant/armv7-addon-ssh with version 8.1
20-01-05 10:31:57 INFO (SyncWorker_11) [hassio.docker.interface] Attach to homeassistant/armv7-addon-configurator with version 4.2
20-01-05 10:31:57 INFO (SyncWorker_2) [hassio.docker.interface] Attach to homeassistant/armv7-addon-samba with version 9.0
20-01-05 10:31:57 INFO (MainThread) [hassio.updater] Fetch update data from https://version.home-assistant.io/stable.json
20-01-05 10:31:57 INFO (MainThread) [hassio.snapshots] Found 5 snapshot files
20-01-05 10:31:57 INFO (MainThread) [hassio.discovery] Load 0 messages
20-01-05 10:31:57 INFO (MainThread) [hassio.ingress] Load 0 ingress session
20-01-05 10:31:57 INFO (MainThread) [hassio.secrets] Load Home Assistant secrets: 3
20-01-05 10:31:57 INFO (MainThread) [__main__] Run Hass.io
20-01-05 10:31:57 INFO (MainThread) [hassio.api] Start API on <IP_ADDRESS>
20-01-05 10:31:57 INFO (MainThread) [hassio.addons] Phase 'initialize' start 0 add-ons
20-01-05 10:31:57 INFO (MainThread) [hassio.addons] Phase 'system' start 0 add-ons
20-01-05 10:31:57 INFO (MainThread) [hassio.addons] Phase 'services' start 3 add-ons
20-01-05 10:31:57 INFO (SyncWorker_17) [hassio.docker.interface] Clean addon_core_samba application
20-01-05 10:31:59 INFO (SyncWorker_18) [hassio.docker.interface] Clean addon_core_duckdns application
20-01-05 10:32:00 INFO (SyncWorker_1) [hassio.docker.interface] Clean addon_core_ssh application
20-01-05 10:32:38 INFO (SyncWorker_17) [hassio.docker.addon] Start Docker add-on homeassistant/armv7-addon-samba with version 9.0
20-01-05 10:32:50 INFO (SyncWorker_18) [hassio.docker.addon] Start Docker add-on homeassistant/armv7-addon-duckdns with version 1.10
20-01-05 10:32:55 INFO (SyncWorker_1) [hassio.docker.addon] Start Docker add-on homeassistant/armv7-addon-ssh with version 8.1
20-01-05 10:33:00 INFO (SyncWorker_5) [hassio.docker.interface] Start homeassistant/raspberrypi3-homeassistant
20-01-05 10:33:23 ERROR (MainThread) [hassio.homeassistant] Home Assistant has crashed!
20-01-05 10:33:23 INFO (MainThread) [hassio.addons] Phase 'application' start 1 add-ons
20-01-05 10:33:23 INFO (SyncWorker_12) [hassio.docker.interface] Clean addon_core_configurator application
20-01-05 10:33:34 INFO (SyncWorker_12) [hassio.docker.addon] Start Docker add-on homeassistant/armv7-addon-configurator with version 4.2
20-01-05 10:33:41 INFO (MainThread) [hassio.tasks] All core tasks are scheduled
20-01-05 10:33:41 INFO (MainThread) [hassio.core] Hass.io is up and running
20-01-05 12:33:41 INFO (MainThread) [hassio.updater] Fetch update data from https://version.home-assistant.io/stable.json
20-01-05 12:40:21 INFO (MainThread) [hassio.host.info] Update local host information
20-01-05 12:40:21 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.DBus.Properties.GetAll on /org/freedesktop/hostname1
20-01-05 12:40:21 INFO (MainThread) [hassio.host.services] Update service information
20-01-05 12:40:21 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.systemd1.Manager.ListUnits on /org/freedesktop/systemd1
20-01-05 12:40:21 INFO (MainThread) [hassio.host.network] Update local network DNS information
20-01-05 12:40:21 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.DBus.Properties.GetAll on /org/freedesktop/NetworkManager/DnsManager
20-01-05 13:33:41 INFO (MainThread) [hassio.store.git] Update add-on https://github.com/home-assistant/hassio-addons repository
20-01-05 13:33:41 INFO (MainThread) [hassio.store.git] Update add-on https://github.com/hassio-addons/repository repository
20-01-05 13:33:43 INFO (MainThread) [hassio.store] Load add-ons from store: 62 all - 0 new - 0 remove
20-01-05 14:33:41 INFO (MainThread) [hassio.updater] Fetch update data from https://version.home-assistant.io/stable.json
20-01-05 14:47:01 INFO (MainThread) [hassio.host.info] Update local host information
20-01-05 14:47:01 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.DBus.Properties.GetAll on /org/freedesktop/hostname1
20-01-05 14:47:01 INFO (MainThread) [hassio.host.services] Update service information
20-01-05 14:47:01 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.systemd1.Manager.ListUnits on /org/freedesktop/systemd1
20-01-05 14:47:01 INFO (MainThread) [hassio.host.network] Update local network DNS information
20-01-05 14:47:01 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.DBus.Properties.GetAll on /org/freedesktop/NetworkManager/DnsManager
20-01-05 16:33:41 INFO (MainThread) [hassio.store.git] Update add-on https://github.com/hassio-addons/repository repository
20-01-05 16:33:41 INFO (MainThread) [hassio.store.git] Update add-on https://github.com/home-assistant/hassio-addons repository
20-01-05 16:33:41 INFO (MainThread) [hassio.updater] Fetch update data from https://version.home-assistant.io/stable.json
20-01-05 16:33:43 INFO (MainThread) [hassio.store] Load add-ons from store: 62 all - 0 new - 0 remove
20-01-05 16:53:41 INFO (MainThread) [hassio.host.info] Update local host information
20-01-05 16:53:41 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.DBus.Properties.GetAll on /org/freedesktop/hostname1
20-01-05 16:53:41 INFO (MainThread) [hassio.host.services] Update service information
20-01-05 16:53:41 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.systemd1.Manager.ListUnits on /org/freedesktop/systemd1
20-01-05 16:53:41 INFO (MainThread) [hassio.host.network] Update local network DNS information
20-01-05 16:53:41 INFO (MainThread) [hassio.utils.gdbus] Call org.freedesktop.DBus.Properties.GetAll on /org/freedesktop/NetworkManager/DnsManager
20-01-05 18:27:44 INFO (MainThread) [hassio.api.security] /homeassistant/logs access from core_ssh
20-01-05 18:28:00 INFO (MainThread) [hassio.api.security] /supervisor/logs access from core_ssh

HomeAssistant logs:
~ $ hassio homeassistant logs
Fatal Python error: initsite: Failed to import the site module
Error processing line 1 of /usr/local/lib/python3.7/site-packages/google_api_core-1.15.0-py3.8-nspkg.pth:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site.py", line 168, in addpackage
    exec(line)
  File "<string>", line 1, in <module>
  File "/usr/local/lib/python3.7/importlib/util.py", line 14, in <module>
    from contextlib import contextmanager
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 724, in exec_module
  File "<frozen importlib._bootstrap_external>", line 857, in get_code
  File "<frozen importlib._bootstrap_external>", line 525, in _compile_bytecode
EOFError: marshal data too short
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site.py", line 579, in <module>
    main()
  File "/usr/local/lib/python3.7/site.py", line 566, in main
    known_paths = addsitepackages(known_paths)
  File "/usr/local/lib/python3.7/site.py", line 349, in addsitepackages
    addsitedir(sitedir, known_paths)
  File "/usr/local/lib/python3.7/site.py", line 207, in addsitedir
    addpackage(sitedir, name, known_paths)
  File "/usr/local/lib/python3.7/site.py", line 178, in addpackage
    import traceback
  File "/usr/local/lib/python3.7/traceback.py", line 5, in <module>
    import linecache
  File "/usr/local/lib/python3.7/linecache.py", line 8, in <module>
    import functools
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 724, in exec_module
  File "<frozen importlib._bootstrap_external>", line 857, in get_code
  File "<frozen importlib._bootstrap_external>", line 525, in _compile_bytecode
ValueError: bad marshal data (invalid reference)

Description of problem:
Home Assistant crashes upon starting.
Based on the log I suspect this issue to be caused because PEP 552 has been implemented, which adds extra 4 bytes to the .pyc header; but this version of setuptools is not aware of that yet. I think setuptools should be updated to v38.4.1.
See these links for further information on this bug:

https://github.com/pypa/setuptools/issues/1257
https://stackoverflow.com/a/55167875

Thanks for this information. I had also that issue and fixed it with an hassio su repair. I will look into this

Hi,
I tried your suggestion, but it failed. Here are the logs:
20-01-06 19:02:34 INFO (MainThread) [hassio.api.security] /supervisor/repair access from core_ssh
20-01-06 19:02:34 INFO (MainThread) [hassio.core] Start repairing of Hass.io Environment
20-01-06 19:02:34 INFO (SyncWorker_14) [hassio.docker] Prune stale containers
20-01-06 19:02:35 INFO (SyncWorker_14) [hassio.docker] Prune stale images
20-01-06 19:03:38 INFO (SyncWorker_14) [hassio.docker] Prune stale builds
20-01-06 19:03:38 INFO (SyncWorker_14) [hassio.docker] Prune stale volumes
20-01-06 19:03:38 INFO (SyncWorker_14) [hassio.docker] Prune stale networks
20-01-06 19:03:38 INFO (MainThread) [hassio.addons] Found 2 add-ons to repair
20-01-06 19:03:38 INFO (MainThread) [hassio.addons] Start repair for add-on: core_configurator
20-01-06 19:03:38 INFO (SyncWorker_4) [hassio.docker.interface] Pull image homeassistant/armv7-addon-configurator tag 4.2.
20-01-06 19:04:29 INFO (MainThread) [hassio.addons] Start repair for add-on: core_check_config
20-01-06 19:04:29 INFO (SyncWorker_12) [hassio.docker.interface] Pull image homeassistant/armv7-addon-check_config tag 3.1.
20-01-06 19:05:43 ERROR (SyncWorker_12) [hassio.docker.interface] Can't install homeassistant/armv7-addon-check_config:3.1 -> 404 Client Error: Not Found ("no such image: homeassistant/armv7-addon-check_config:3.1: No such image: homeassistant/armv7-addon-check_config:3.1").
20-01-06 19:05:43 ERROR (MainThread) [hassio.addons] Can't repair core_check_config
20-01-06 19:05:43 INFO (SyncWorker_0) [hassio.docker.interface] Remove image homeassistant/armv7-addon-check_config with latest and 3.1
20-01-06 19:05:43 INFO (MainThread) [hassio.addons.addon] Remove add-on data folder /data/addons/data/core_check_config
20-01-06 19:05:44 INFO (MainThread) [hassio.addons] Add-on 'core_check_config' successfully removed
20-01-06 19:05:44 INFO (MainThread) [hassio.homeassistant] Repair Home Assistant 0.103.5
20-01-06 19:05:44 INFO (SyncWorker_5) [hassio.docker.interface] Pull image homeassistant/raspberrypi3-homeassistant tag 0.103.5.
20-01-06 19:07:02 ERROR (SyncWorker_5) [hassio.docker.interface] Can't install homeassistant/raspberrypi3-homeassistant:0.103.5 -> 404 Client Error: Not Found ("no such image: homeassistant/raspberrypi3-homeassistant:0.103.5: No such image: homeassistant/raspberrypi3-homeassistant:0.103.5").
20-01-06 19:07:02 ERROR (MainThread) [hassio.homeassistant] Repairing of Home Assistant fails
20-01-06 19:07:02 INFO (MainThread) [hassio.hassos] Repair HassOS CLI 15
20-01-06 19:07:02 INFO (SyncWorker_11) [hassio.docker.interface] Pull image homeassistant/armv7-hassio-cli tag 15.
20-01-06 19:07:05 INFO (SyncWorker_11) [hassio.docker.interface] Tag image homeassistant/armv7-hassio-cli with version 15 as latest
20-01-06 19:07:07 INFO (MainThread) [hassio.supervisor] Repair Supervisor 193
20-01-06 19:07:11 INFO (MainThread) [hassio.core] Finished repairing of Hass.io Environment

If I try to update homeassistant, then this also fails similarly:
20-01-06 19:18:47 INFO (MainThread) [hassio.api.security] /homeassistant/update access from core_ssh
20-01-06 19:18:47 INFO (MainThread) [hassio.homeassistant] Update Home Assistant to version 0.103.5
20-01-06 19:18:47 INFO (SyncWorker_0) [hassio.docker.interface] Update image homeassistant/raspberrypi3-homeassistant:0.103.5 to homeassistant/raspberrypi3-homeassistant:0.103.5
20-01-06 19:18:47 INFO (SyncWorker_0) [hassio.docker.interface] Pull image homeassistant/raspberrypi3-homeassistant tag 0.103.5.
20-01-06 19:18:56 ERROR (SyncWorker_0) [hassio.docker.interface] Can't install homeassistant/raspberrypi3-homeassistant:0.103.5 -> 404 Client Error: Not Found ("no such image: homeassistant/raspberrypi3-homeassistant:0.103.5: No such image: homeassistant/raspberrypi3-homeassistant:0.103.5").
20-01-06 19:18:56 WARNING (MainThread) [hassio.homeassistant] Update Home Assistant image fails
20-01-06 19:19:10 INFO (MainThread) [hassio.api.security] /homeassistant/logs access from core_ssh
20-01-06 19:19:20 INFO (MainThread) [hassio.api.security] /supervisor/logs access from core_ssh

I downgraded homeassistant from latest 0.103.5 to 0.103.4 using hassio homeassistant update --version=0.103.4:
20-01-06 19:40:15 INFO (MainThread) [hassio.homeassistant] Update Home Assistant to version 0.103.4
20-01-06 19:40:15 INFO (SyncWorker_18) [hassio.docker.interface] Update image homeassistant/raspberrypi3-homeassistant:0.103.5 to homeassistant/raspberrypi3-homeassistant:0.103.4
20-01-06 19:40:15 INFO (SyncWorker_18) [hassio.docker.interface] Pull image homeassistant/raspberrypi3-homeassistant tag 0.103.4.
20-01-06 19:58:08 INFO (MainThread) [hassio.homeassistant] Successful run Home Assistant 0.103.4

Next I redid the repair:
~ $ hassio su repair
Processing... Done.
Command completed successfully.

Logs now indicate the repair completed without errors:
20-01-06 21:44:24 INFO (MainThread) [hassio.core] Start repairing of Hass.io Environment
20-01-06 21:44:24 INFO (SyncWorker_7) [hassio.docker] Prune stale containers
20-01-06 21:44:24 INFO (SyncWorker_7) [hassio.docker] Prune stale images
20-01-06 21:44:34 INFO (SyncWorker_7) [hassio.docker] Prune stale builds
20-01-06 21:44:34 INFO (SyncWorker_7) [hassio.docker] Prune stale volumes
20-01-06 21:44:34 INFO (SyncWorker_7) [hassio.docker] Prune stale networks
20-01-06 21:44:35 INFO (MainThread) [hassio.addons] Found 1 add-ons to repair
20-01-06 21:44:35 INFO (MainThread) [hassio.addons] Start repair for add-on: core_configurator
20-01-06 21:44:35 INFO (SyncWorker_2) [hassio.docker.interface] Pull image homeassistant/armv7-addon-configurator tag 4.2.
20-01-06 21:45:11 INFO (MainThread) [hassio.homeassistant] Repair Home Assistant 0.103.4
20-01-06 21:45:11 INFO (SyncWorker_0) [hassio.docker.interface] Pull image homeassistant/raspberrypi3-homeassistant tag 0.103.4.
20-01-06 21:47:13 INFO (MainThread) [hassio.api.security] /supervisor/logs access from core_ssh
20-01-06 21:50:07 INFO (MainThread) [hassio.api.security] /supervisor/logs access from core_ssh
20-01-06 22:03:45 INFO (MainThread) [hassio.hassos] Repair HassOS CLI 15
20-01-06 22:03:45 INFO (SyncWorker_15) [hassio.docker.interface] Pull image homeassistant/armv7-hassio-cli tag 15.
20-01-06 22:03:47 INFO (SyncWorker_15) [hassio.docker.interface] Tag image homeassistant/armv7-hassio-cli with version 15 as latest
20-01-06 22:03:47 INFO (MainThread) [hassio.supervisor] Repair Supervisor 193
20-01-06 22:03:48 INFO (MainThread) [hassio.core] Finished repairing of Hass.io Environment

But when I start homeassistant, I'm back to where I started with the original error:
~ $ hassio homeassistant start
Processing... Done.

Error: Unknown Error, see logs
~ $ hassio homeassistant logs
Fatal Python error: initsite: Failed to import the site module
Error processing line 1 of /usr/local/lib/python3.7/site-packages/google_api_core-1.15.0-py3.8-nspkg.pth:
Traceback (most recent call last):
...
...
ValueError: bad marshal data (unknown type code)

We have no setup tools inside because the package is installed. If you disable the component they import this module, everthing work?

homeassistant 0.103.6 is released, I tried updating to that version and now my homeassistant is up and running again!
But things are not fully fixed, The "Configurator" add-on no longer works, when checking the log I see the exact same type of error:
Traceback (most recent call last):
  File "/usr/local/bin/hass-configurator", line 3, in <module>
    import re
  File "/usr/local/lib/python3.7/re.py", line 122, in <module>
    import enum
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 724, in exec_module
  File "<frozen importlib._bootstrap_external>", line 857, in get_code
  File "<frozen importlib._bootstrap_external>", line 525, in _compile_bytecode
ValueError: bad marshal data (unknown type code)

My understanding of this error is that there are *.pyc files with a format incompatible with the current _compile_bytecode. Now here it concerns a standard Python module: 'enum'.
I don't know the details on the hassio update flow, but on my system there's somehow a mismatch between the provided pyc file format in the docker images and the Python pyc bytecode loading scripts.
I triead a hassio su repair, the log shows it 'repairs' the configurator addon, but testing afterwards shows the same issue...

It could be that your SD card is going defect and if they create the container, varia bytes are corrupt. The best thing on docker, all or no one has an issue, if someone has an issue, there are local issues.


Customise Export to export columns not visible in grid

My "regions" table has 10 columns, but not all columns are visible in grid (only 6 are visible, all data is visible on clicking view button of particular row).
But, when I click on export, I want to export all 10 columns.
Is it possible to add hidden columns to table?

Currently, columns listed on the grid can be/not exported. If your column is on the grid, all you need to do for it to be exported is this;

Assuming its called name

"name" => ["export" => true];

If you change to false, the column will not be exported.
If the column is not in the columns array (the one where you define your columns), then it wont be exported. Since exporting only works off this values.

https://github.com/leantony/laravel-grid/blob/master/docs/general.md#export

Can we add feature, where we can export columns even if not in "columns" array or at least not visible in table (in ui) but in "columns" array as hidden column.

I do not think a feature is required for this...
You can follow the instructions here to try out something that covers your scenario.
And then probably create a button for it on the grid

Check this out. I think it might be able to sort you out.
There's a hidden config parameter I introduced sometime ago...had actually forgotten about it.
Try changing it to false, and see if it does sort you out. If it doesn't just add a comment on this issue, and I'll see what I can do

Above scenario doesn't solve my issue.
Consider this example, I have regions table with following columns:

id
name
latitude
longitude
keywords
description

Now "description" column has text data so I don't want to render it in grid. My grid has following columns only:

id
name
latitude
longitude
keywords

So when I export, it is exporting only these 5 columns. But, I want description also to be exported. It can be solved using hidden columns in grid table.


Build PHP extensions from source with docker-php-ext-*

Is your feature request related to a problem? Please describe.
The official PHP Docker Images provides convenient docker-php-ext-configure, docker-php-ext-enable, docker-php-ext-install commands for building PHP extensions from source. This is often useful when you need to build an extension from source on the GitHub, when the branch is still under development and is not in any repositories.
An example: Build Phalcon Framework v5.0.x, which is still in alpha for further testing and adaptation with the codebase of our project.
Describe the solution you'd like
Reimplement and provide these helper scripts in DDEV images.
Describe alternatives you've considered
https://github.com/docker-library/php/tree/master/7.4/buster/fpm

You can use this technique to build anything that's in pecl: https://stackoverflow.com/questions/60554989/how-can-i-install-a-pecl-extension-like-mcrypt-in-ddev-locals-web-container - does that work for you?

Of course, we can install all the necessary extensions using the full installation commands - install gcc, php-dev, etc. for the extension stack. However, for many years there have been special helper scripts in the official docker-php repositories that make this task much easier when you need to build many extensions.

In your custom Dockerfile you can just curl those scripts and use them, of course.

I first tried this out in https://github.com/drud/ddev-contrib/pull/141 and my goodness is it nice. And so easy to add (I think)

For future reference, these are in https://github.com/docker-library/php, but unfortunately very-little documented, and of course they're focused on a single version of PHP. It's not clear to me how the PHP source is to be obtained.

docker-php-source requires the proper php source to already be downloaded. I get
rfay@d9-web:/usr/local/bin$ sudo docker-php-ext-install mcrypt
tar (child): /usr/src/php.tar.xz: Cannot open: No such file or directory
tar (child): Error is not recoverable: exiting now
tar: Child returned status 2
tar: Error is not recoverable: exiting now

@StudioMaX would love it if you could take a look at the request in https://github.com/drud/ddev/pull/3071#issuecomment-868789753

This will be a great project for ddev-contrib, but it's not appropriate for the huge image size increase that would result from adding it. I didn't realize how much beyond the scripts was required.


Add Fedora installation instructions

gopass is now avaialbe in official Fedora repositories.
See blog post, src.fpo

Wow, that's amazing. Thanks a lot. Also for the blog post!

Great, thanks.
It's true we never thought about how moving to Go 1.18 could be hurting mainstream adoption by official repositories that do not package Go in its latest version.

Happy to help :-).
On the 1.18 topic, yes, some older versions could have the issue, but soon major distros will have 1.18+, I hope.
In a couple of weeks the Fedora stable version will be F36, which has go 1.18. F35 will go EOL in 7 months, after which all Fedora supported releases will be ok.
Other distros (I think for instance Debian) might have a longer lag, though!


Train on custom dataset

Hi, I really appreciate for the work you've done.
I wondered if the training code will be released, which can be used to train our custom dataset, thanks.
Best regards.

Hi @JiananZhao0224, many thanks for your interest in Patch-NetVLAD. We will release training code in the next few weeks.
Best, Tobias

Hi! I'm very inspired by your wonderful work! Could you tell me when you will release the training code? I want to train it myself.  Thanks.
Best, Huaiyuan

Hi @wzxuhuaiyuan, thanks for your interest in our work! We will have the training code released by the end of this month at the very latest.

Just in time - @StephenHausler managed to get it done in https://github.com/QVPR/Patch-NetVLAD/pull/20
Please let us know if you run into issues.

Hi @Tobias-Fischer , I'd like really to show my appreciation for your work but I want to know if there is a provided code for training Patch-NetVLAD on a custom dataset or how to build my dataset to be compatible with the available code
thanks in advance.

Hi @alien19, many thanks for your message. At the moment we do not support training on a custom dataset in this repository. I'll chat again with @StephenHausler to see how much work it would be for us to support this - but unfortunately it is not a priority at the moment with several deadlines coming up for us.

Thanks @Tobias-Fischer, looking forward to your reply and good luck with your deadlines.
But for now if you can provide a brief about the Mapillary dataloader or the metadata required for training the model, I'd be very thankful.

Hi, do you have any specific questions? Most of the code is in https://github.com/QVPR/Patch-NetVLAD/tree/main/patchnetvlad/training_tools

Thank you @Tobias-Fischer, I checked most of the code (not all yet) in order to try the training code with the "Mapillary dataset" so, now I want to know how to form my dataset in order to supply the model with it for training (already checked that there are 4 metadata files)

Hello, I am also trying to train Patch-NetVLAD on a custom dataset, but it's not going very well. I would like to ask if you have solved this problem, or if it is convenient to communicate this problem together.

@alien19

Hi @Zhaozhpe , I cannot remember what I have reached in that problem since it has been a while ago (I will check though). Until then, yes we can communicate to solve it together. just tell me the point u have reached or ping me on<EMAIL_ADDRESS>to discuss further details.

Hi! Can I get advice about training on a custom dataset? I think this repository doesn't support training on a custom dataset directly. I need to implement original netVLAD with PCA and this repository help me out about what I wonder. But the code for a custom dataset is missing. @alien19 , may I contact you via mail address you wrote?

Hi, I can try and offer some tips that might help. For a custom dataset, a lot of the training code will stay the same as in msls.py. You can pretty much reuse these functions from msls.py:
def getitem()
def update_subcache()
def new_epoch()
Writing a new init() function will require the most work. In init, you need to add in code to find positive images for training (you need GPS data for this), to fill in a pos_indices variable (see line 157 of msls.py). You'll need to populate some self.qIdx, self.pIdx and self.negIdx (indices to locations in query/reference sets) and self.qImages, self.dbImages containing paths to the respective query/reference image sets for your new dataset.


[LUIS Authoring] Missing 429 Response Code in the Swagger

This issue has been reported by customer related to LUIS Authoring JS SDK. While making calls with the SDK, the service returns a 429 Response code. This status code refers to Too Many Requests. This response code should have been handled by RetryPolicy. But, the SDK considers it as an error.
While investigating this issue, I found the response code 429 was never defined in the Swagger which is incorrect. You can find several examples in specs repository where services define 429 as valid response code. (Web, Communication, etc). A service is supposed to define all possible response codes. But, this service does not define 429 code but responds with it. This swagger has to be fixed.
File to be updated: https://github.com/Azure/azure-rest-api-specs/blob/main/specification/cognitiveservices/data-plane/LUIS/Authoring/preview/v3.0/LUIS-Authoring.json

@heaths as far as I know, the guidance we've been getting is to only include the success status codes and have a "default" status code for all other failures. What's the action we should take here? This issue will apply for Language (and any APIM-backed service) as well.

Correct. Our guidelines state specific error codes should not be documented. Any error could happen and callers should be prepared.


[release/v7.4.1] Fix rendering of DisplayRoot for network PSDrive

Backport #20793

All CIs passed except the markdown link check, which is not related to the ported PR.

Backport #20793

Why 'backport'?

Seems there's an issue with this in 7.4.1 GA, as reported in https://github.com/PowerShell/PowerShell/issues/21064


MINOR: feat: refactor table selection feature

[ ] I have tested my component
[x] I have updated the documentation or there is no documentation needed

:tada: This PR is included in version 1.4.0-rc.62 :tada:
The release is available on:

npm package (@next dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 2.0.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Password Custom secret projection fails

What steps did you take:
I went through the example for Password custom secret projection. In particular:

With custom secret projection:
apiVersion: secretgen.k14s.io/v1alpha1
kind: Password
metadata:
name: pg-password
spec:
secretTemplate:
stringData:
postgresql-pass: $(value)
would produce:
apiVersion: v1
kind: Secret
metadata:
name: pg-password
data:
postgresql-pass: xxx...

What happened:
However, reconciliation failed:
$ kubectl get passwords.secretgen.k14s.io pg-password -oyaml
apiVersion: secretgen.k14s.io/v1alpha1
kind: Password
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: |
      {"apiVersion":"secretgen.k14s.io/v1alpha1","kind":"Password","metadata":{"annotations":{},"name":"pg-password","namespace":"default"},"spec":{"secretTemplate":{"stringData":{"postgresql-pass":"$(value)"}}}}
  creationTimestamp: "2022-02-07T08:54:47Z"
  generation: 2
  name: pg-password
  namespace: default
  resourceVersion: "329229"
  selfLink: /apis/secretgen.k14s.io/v1alpha1/namespaces/default/passwords/pg-password
  uid: 74b90367-f00f-4115-a717-b759ab7f61ec
spec:
  secretTemplate:
    stringData:
      postgresql-pass: $(value)
status:
  conditions:
  - message: 'Secret "pg-password" is invalid: [data[%s][username]: Required value,
      data[%s][password]: Required value]'
    status: "True"
    type: ReconcileFailed
  friendlyDescription: 'Reconcile failed: Secret "pg-password" is invalid: [data[%s][username]:
    Required...'
  observedGeneration: 2

What did you expect:
I expected to see creation of a Secret like:
---
apiVersion: v1
kind: Secret
metadata:
  name: my-secret
stringData:
  maxmax: <crazy-generated-secret-value>

Anything else you would like to add:
[Additional information that will assist in solving the issue.]
Environment:

secretgen-controller version (execute kubectl get deployment -n secretgen-controller secretgen-controller -o yaml and the annotation is kbld.k14s.io/images):

apiVersion: apps/v1
kind: Deployment
metadata:
  annotations:
    deployment.kubernetes.io/revision: "2"
    kapp.k14s.io/identity: v1;secretgen-controller/apps/Deployment/secretgen-controller;apps/v1
    kapp.k14s.io/original: '{"apiVersion":"apps/v1","kind":"Deployment","metadata":{"annotations":{"kbld.k14s.io/images":"-
      origins:\n  - local:\n      path: /Users/jkimmel/go/src/github.com/vmware-tanzu/carvel-secretgen-controller\n  -
      git:\n      dirty: false\n      remoteURL: git@github.com:vmware-tanzu/carvel-secretgen-controller.git\n      sha:
      459cddee3dea7b8cad5cc4d83f4bcf6d798c8963\n      tags:\n      - v0.7.1\n  url:
      ghcr.io/vmware-tanzu/carvel-secretgen-controller@sha256:883d6312b37597b6b65cf6ec7f2e70137a17f0c8e27211b60f3f3c3764ee7a3d\n","secretgen-controller.carvel.dev/version":"v0.7.1"},"labels":{"kapp.k14s.io/app":"1643973051553253000","kapp.k14s.io/association":"v1.1a0485fb29b825f0bdc2567860b4b9f4"},"name":"secretgen-controller","namespace":"secretgen-controller"},"spec":{"replicas":1,"revisionHistoryLimit":0,"selector":{"matchLabels":{"app":"secretgen-controller","kapp.k14s.io/app":"1643973051553253000"}},"template":{"metadata":{"labels":{"app":"secretgen-controller","kapp.k14s.io/app":"1643973051553253000","kapp.k14s.io/association":"v1.1a0485fb29b825f0bdc2567860b4b9f4"}},"spec":{"containers":[{"image":"ghcr.io/vmware-tanzu/carvel-secretgen-controller@sha256:883d6312b37597b6b65cf6ec7f2e70137a17f0c8e27211b60f3f3c3764ee7a3d","name":"secretgen-controller","resources":{"requests":{"cpu":"120m","memory":"100Mi"}},"securityContext":{"runAsGroup":2000,"runAsUser":1000}}],"securityContext":{"fsGroup":3000},"serviceAccount":"secretgen-controller-sa"}}}}'
    kapp.k14s.io/original-diff-md5: cbd70c8d709d48c3d44e2720253a1e05
    kbld.k14s.io/images: |
      - origins:
        - local:
            path: /Users/jkimmel/go/src/github.com/vmware-tanzu/carvel-secretgen-controller
        - git:
            dirty: false
            remoteURL: git@github.com:vmware-tanzu/carvel-secretgen-controller.git
            sha: 459cddee3dea7b8cad5cc4d83f4bcf6d798c8963
            tags:
            - v0.7.1
        url: ghcr.io/vmware-tanzu/carvel-secretgen-controller@sha256:883d6312b37597b6b65cf6ec7f2e70137a17f0c8e27211b60f3f3c3764ee7a3d
    secretgen-controller.carvel.dev/version: v0.7.1
  creationTimestamp: "2022-02-04T11:10:58Z"
  generation: 4
  labels:
    kapp.k14s.io/app: "1643973051553253000"
    kapp.k14s.io/association: v1.1a0485fb29b825f0bdc2567860b4b9f4
  name: secretgen-controller
  namespace: secretgen-controller

Kubernetes version (use kubectl version):

Client Version: version.Info{Major:"1", Minor:"23", GitVersion:"v1.23.1", GitCommit:"86ec240af8cbd1b60bcc4c03c20da9b98005b92e", GitTreeState:"clean", BuildDate:"2021-12-16T11:33:37Z", GoVersion:"go1.17.5", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.11", GitCommit:"c6a2f08fc4378c5381dd948d9ad9d1080e3e6b33", GitTreeState:"clean", BuildDate:"2021-05-27T23:47:11Z", GoVersion:"go1.15.12", Compiler:"gc", Platform:"linux/amd64"}
WARNING: version difference between client (1.23) and server (1.19) exceeds the supported minor version skew of +/-1

Vote on this request
This is an invitation to the community to vote on issues, to help us prioritize our backlog. Use the "smiley face" up to the right of this comment to vote.
👍 "I would like to see this addressed as soon as possible"
👎 "There are other more important things to focus on right now"
We are also happy to receive and review Pull Requests if you want to help working on this issue.

Found the issue. type: Opaque is missing from the example YAML. Opened #51.
🙇🏻


Configuration of relative paths

Hi guys, with this config
injector: {
  options: {
    relative: true
  }
}

It should set addRootSlash to !options.relative so, addRootSlash in this case should be false but it still compiling with absolute paths. ref https://github.com/klei/grunt-injector/blob/master/tasks/injector.js#L30
So the only way to use relative paths, is to explicitly set addRootSlash to false
injector: {
  options: {
    addRootSlash: false
  }
},

npm version out put
{ npm: '2.9.0',
  http_parser: '2.3',
  modules: '14',
  node: '0.12.2',
  openssl: '1.0.1m',
  uv: '1.4.2-node1',
  v8: '3.28.73',
  zlib: '1.2.8' }

I was using ignorePath to ignore src/, I removed ignorePath and relative: true does the work and ignored src/ path, but still with a absolute path with /, if it is the right behave of relative feel free to close this issue :)
My options became:
injector: {
  options: {
    starttag: '<!-- facebook:{{ext}} -->',
    endtag: '<!-- endfacebook -->',
    relative: true,
    addRootSlash: false
  },
  browser: {
    files: {
      '<%= config.app %>/index.html': ['<%= config.app %>/bower_components/facebook-plugin/index.js'],
    }
  },
},

With this result:
<!-- facebook:js -->
  <script src="bower_components/facebook-plugin/index.js"></script>
<!-- endfacebook -->

Only using relative: true the output is:
<!-- facebook:js -->
  <script src="/bower_components/facebook-plugin/index.js"></script>
<!-- endfacebook -->

Only with relative: true should do the trick based on line 30

I cannot recreate the issue. It's working for me by only setting relative: true to get paths without a leading /. Are you sure you're running the correct version of the plugin?


[Question] ERC20 compatible ?

Hi, is the address generated by VanityEth ERC20 compatible ?
Thanks!

So if anyone needs to know, the answer is yes.


Hide protected keys in namespace

currently shows up in documentation

Fixed in https://github.com/cdgriffith/Reusables/pull/14


pandoc: remove GHC & haskell deps from closure, 5.2G => 250M

Continuation of https://github.com/NixOS/nixpkgs/pull/264423, except it's targetting haskell-updates. (I'm too affraid doing something wrong and mass-pinging ppl on the other one)
Description of changes
The Haskell dependencies were leaking through a haskellPackages.pandoc stray references:
$ strings ./result/bin/pandoc | grep /nix/store
(...)
/nix/store/xk2acjd6587wyskg85xg54lj89mrvrv0-pandoc-3.1.8/etc /nix/store/xk2acjd6587wyskg85xg54lj89mrvrv0-pandoc-3.1.8/libexec/x86_64-linux-ghc-9.4.7/pandoc-3.1.8 /nix/store/l9mzh2nlq5qs50yfvb3ymphfpas0j7pd-pandoc-3.1.8-data/share/ghc-9.4.7/x86_64-linux-ghc-9.4.7/pandoc-3.1.8 /nix/store/xk2acjd6587wyskg85xg54lj89mrvrv0-pandoc-3.1.8/lib/ghc-9.4.7/x86_64-linux-ghc-9.4.7 /nix/store/xk2acjd6587wyskg85xg54lj89mrvrv0-pandoc-3.1.8/lib/ghc-9.4.7/x86_64-linux-ghc-9.4.7/pandoc-3.1.8-DUwbvTsa4nj3Hikhs5AQGF /nix/store/xk2acjd6587wyskg85xg54lj89mrvrv0-pandoc-3.1.8/bin
Removing these references using "remove-reference-to".
Before:
$ nix path-info --closure-size -h $(nix-build -A pandoc)
/nix/store/np2f5g1x25fgkp6q10n5p14352899km7-pandoc-cli-<IP_ADDRESS>     5.2G
After:
$ nix path-info --closure-size -h $(nix-build -A pandoc)
/nix/store/fpl2h3qs6vm0vb5cibb7cswzm90hc4yx-pandoc-cli-<IP_ADDRESS>   250.5M
Fixes https://github.com/NixOS/nixpkgs/issues/264399
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/how-to-convert-md-to-pdf-most-efficently/34808/5

Thx, seems to work!