zfind: 0.4.5 -> 0.4.6

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/laktak/zfind/releases.
meta.description for zfind is: CLI for file search with SQL like syntax.
meta.homepage for zfind is: https://github.com/laktak/zfind
meta.changelog for zfind is: https://github.com/laktak/zfind/releases/tag/v0.4.6
Updates performed

Golang update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.4.6 with grep in /nix/store/9bpmywk9g5iwm7qk2828d6sdi6mpc9pa-zfind-0.4.6
found 0.4.6 in filename of file in /nix/store/9bpmywk9g5iwm7qk2828d6sdi6mpc9pa-zfind-0.4.6

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath

zfind

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/9bpmywk9g5iwm7qk2828d6sdi6mpc9pa-zfind-0.4.6 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A zfind https://github.com/r-ryantm/nixpkgs/archive/4bd5790369dbcff0957d8cda4e7ba2244e88d54b.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/4bd5790369dbcff0957d8cda4e7ba2244e88d54b#zfind

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/9bpmywk9g5iwm7qk2828d6sdi6mpc9pa-zfind-0.4.6
ls -la /nix/store/9bpmywk9g5iwm7qk2828d6sdi6mpc9pa-zfind-0.4.6/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
nixpkgs-review result
Generated using nixpkgs-review.
Command: nixpkgs-review

x86_64-linux

:white_check_mark: 1 package built:

zfind

Maintainer pings
cc @eeedean for testing.

[!TIP]
As a maintainer, if your package is located under pkgs/by-name/*, you can comment @NixOS/nixpkgs-merge-bot merge to automatically merge this update using the nixpkgs-merge-bot.

Add a :+1: reaction to pull requests you find important.

nixpkgs-review result
Generated using nixpkgs-review.
Command: nixpkgs-review pr 354372

aarch64-darwin

:white_check_mark: 1 package built:

zfind

@NixOS/nixpkgs-merge-bot merge


get_sbom() doesn't return SBOMData

As title states, the method get_sbom() specifically both CycloneDXParser.get_sbom() and SBOM.get_sbom()
These have type hint they return SBOMData but in fact return the property sbom which is a dict.
I can't actually find how to access the SBOMData after the parser finishes, mainly because this dict only includes {'type': 'cyclonedx'} and all the other data is simply missing..
reproduce data created via cyclonedx-py requirements -o sbom.cdx.json --of json --sv 1.6 requirements.txt with any libs really.

Can you provide an example of the SBOM which you are trying to parse?
If the parser fails, then no data will be returned in the SBOMData structure. This is often due to a failure in the processing of the metadata. There have been some recent changes in the parsing of the metadata (to make it more robust) so using the latest version in the repo may work.

I did describe how to get the SBOM data, so instead I might try trunk and see if the problem persists

I did describe how to get the SBOM data, so instead I might try trunk and see if the problem persists

It seems to work with the latest version in the repo.


Add random delay to queries with sameDomainDelay set

Some websites have added detection for query frequency. If the delay between queries is regular, it will raise a flag. This option lets the user decide if a random delay (more or less the value set) should be applied to the standard delay.
Code AND doc have been updated to reflect this feature.

@thomasdondorf Could you please merge this?


Re exec Readme Update

I added some documentation around the --reexec-as option that is offered. I am open to suggestions on wording and placement! Thanks!

This looks good to me, thanks!


Improve enum coversion for protobuf checks

protobuf.js does not handle JSON string to enum conversio so we do
this ourselves.  We now properly handle package scope enums and name
lookups.  This lets us handle more complicated XVIZ protobuf files.

This was merged incorrectly so it was pushed by hand in 8d0a0e5c530f4b36acde7f40a436d34145bb88be


Is "Couldn't select trade" ViaVersion issue?

What is the output link of /viaversion dump?
https://gist.github.com/anonymous/b558a0a00ed7b904e946a9c1d8411352
Are you using any additional software like BungeeCord? If so, what software and version? (Please list your plugins as well)
BungeeCord, ServerListPlus
How does this error happen? login? Using an item?
Randomly on login...
Is there an error in the console? Use pastebin.com. Is there a kick message?
[05:57:23 ERROR]: Couldn't select trade
java.lang.IndexOutOfBoundsException
        at io.netty.buffer.EmptyByteBuf.readInt(EmptyByteBuf.java:470) ~[patched.jar:git-TacoSpigot-"65fd35f"]
        at net.minecraft.server.v1_8_R3.PacketDataSerializer.readInt(PacketDataSerializer.java:547) ~[patched.jar:git-TacoSpigot-"65fd35f"]
        at net.minecraft.server.v1_8_R3.PlayerConnection.a(PlayerConnection.java:2054) [patched.jar:git-TacoSpigot-"65fd35f"]
        at net.minecraft.server.v1_8_R3.PacketPlayInCustomPayload.a(SourceFile:55) [patched.jar:git-TacoSpigot-"65fd35f"]
        at net.minecraft.server.v1_8_R3.PacketPlayInCustomPayload.a(SourceFile:8) [patched.jar:git-TacoSpigot-"65fd35f"]
        at net.minecraft.server.v1_8_R3.PlayerConnectionUtils$1.run(SourceFile:13) [patched.jar:git-TacoSpigot-"65fd35f"]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_111]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_111]
        at net.minecraft.server.v1_8_R3.SystemUtils.a(SourceFile:44) [patched.jar:git-TacoSpigot-"65fd35f"]
        at net.minecraft.server.v1_8_R3.MinecraftServer.B(MinecraftServer.java:774) [patched.jar:git-TacoSpigot-"65fd35f"]
        at net.minecraft.server.v1_8_R3.DedicatedServer.B(DedicatedServer.java:378) [patched.jar:git-TacoSpigot-"65fd35f"]
        at net.minecraft.server.v1_8_R3.MinecraftServer.A(MinecraftServer.java:713) [patched.jar:git-TacoSpigot-"65fd35f"]
        at net.minecraft.server.v1_8_R3.MinecraftServer.run(MinecraftServer.java:616) [patched.jar:git-TacoSpigot-"65fd35f"]
        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_111]
[05:57:23 INFO]: Player lost connection: Invalid trade data!

I'm not even sure if this is ViaVersion issue?

You need to provide more info, I have no idea how to replicate this.

It seems to be random and it's also happening on our lobbies (no villagers or trading plugins there).

Could this be related to EchoPet?

Could be, we're running EchoPet there.

I think you have the same problem as me: https://github.com/MylesIsCool/ViaVersion/issues/618

https://github.com/PaperMC/Paper/issues/388
Just ignore, hacked client, ban.


Test on prereleases of bluesky, event-model.

This adds a single build to the matrix that tests against prereleases of bluesky and event-model.
Relevant section of GH Actions docs: https://docs.github.com/en/actions/writing-workflows/choosing-what-your-workflow-does/running-variations-of-jobs-in-a-workflow#example-adding-configurations

Confirmed that the "prerelease" build added by this PR indeed installed the event-model prerelease:
Successfully installed event-model-1.22.1rc1

link to log line
All tests pass.


Use new Travis CI container infrastructure

http://blog.travis-ci.com/2014-12-17-faster-builds-with-container-based-infrastructure/
Signed-off-by: Chris Aniszczyk<EMAIL_ADDRESS>

cc: @WamBamBoozle build speed improved quite a bit, ~50%!

Thank-you! If there are two platforms, java 6 & java 7, and you drop one of
them, I would expect a 50% speedup. Am I missing something?
On Tue, Jan 13, 2015 at 11:49 AM, Chris Aniszczyk<EMAIL_ADDRESS>wrote:

cc: @WamBamBoozle https://github.com/WamBamBoozle build speed improved
quite a bit, ~50%!
—
Reply to this email directly or view it on GitHub
https://github.com/twitter/iago/pull/41#issuecomment-69807291.

Oh sigh, you're right


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

Merging #3231 (8a296b4) into main (c7f71d3) will decrease coverage by 0.31%.
The diff coverage is n/a.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@            Coverage Diff             @@
##             main    #3231      +/-   ##
==========================================
- Coverage   93.20%   92.90%   -0.31%
==========================================
  Files         167      167
  Lines        4622     4622
==========================================
- Hits         4308     4294      -14
- Misses        314      328      +14

Impacted Files
Coverage Δ

src/system/temporary_directory.py
64.44% <0.00%> (-28.89%)
:arrow_down:

src/system/os.py
94.73% <0.00%> (-5.27%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Changing package.runtime.dependencies doesn't work for rebuilds

If I make changes to that section, it seems that the APKINDEX does not reflect the new data in the built folder.. which means you have to do a full rebuild (or I have to figure out a way to regeneraet APKINDEX...)

When you change a package's dependencies, you must increment the epoch in order for the new package to be indexed.


in "link reporting -> other" add a textbox to allow specifying the reason

Description
in "link reporting -> other" add a textbox to allow specifying the reason
Screenshots

Additional information
No response

Hey @8hachar,
I believe most of the cases are listed in the dropdown.
It's certainly not a bug.


add support for nightly builds

I have to read up on github actions more. In the meantime the most recent build can be found here: https://github.com/Kethku/neovide/actions

I'm closing this in favor of the CI builds. No need for nightly if they are built after every commit


Update cargo manifest keywords, categories

Change cargo.toml keywords: keywords = ["color", "conversion", "linear", "pixel", "rgb"]
Add cateogries to cargo.toml: categories = ["graphics", "multimedia::images", "no-std"]
Add travis-ci badge to cargo.toml
Reduce dev-dependencies features for crates used in palette examples, results in reduction from 131 to 82 crates built for cargo test --features strict
Add docs.rs badge to README.md
This addresses some parts of #167  along with other improvements found while preparing my first crate to publish.

I believe the remaining parts to improve are:

updating the description in the manifest, if needed
adding a feature description to the README, which is indexed by crates.io
resolving whether there should be separate readmes for repo root/crates.io

I wasn't sure if any of those should be part of this PR.

For changing the dev-dependencies, I didn't see a reason to keep building the extra 49 crates for the examples. That time adds up, especially on a slower computer I use sometimes to work on palette, if I ran cargo clean or used a new nightly. I don't think much more can be trimmed or would be worth changing.

My speed test experiment didn't show much, by the way. (36 vs 32 minutes) But I don't think those particular dependencies are rebuilt a lot.

Yes, I believe they get used as cached results so it won't be that large of an effect and I'm not sure how much of that is in the CI runner noise.

Looking at the history, I think one can expect it to vary with as much as 3 minutes, if not more. And it makes sense that they would only be built once, since they are not toggled by features. It's not a good benchmark in that sense. I just noticed the built time was much shorter than the previous PR and wanted to know why, but they more likely just fixed the regressions from before.

Oh, I looked at the wrong time again. They show the time without the waiting in a different place and they were even closer, but still, not a good benchmark for this.

Yes, I'm not sure of how to benchmark it properly, aside from seeing how many crates are being built on a clean build.
I know you can check https://perf.rust-lang.org/ which can help correlate past build runs to performance at the time. I believe there was a change within the past week or two which mostly affected clap instruction counts with a 2-5% reduction in compile time. You can see if you ctrl-F clap.

Yes, looks like something improved there, and that would have been between now and the previous PR. No matter what Travis machines show, I think it's a good change. I'll merge it and we can take the rest separately.
bors r+


Update configure.xml

Changed "If the log file cannot be found" to "If the configuration file cannot be found".

@rumata28 Please sign the Contributor License Agreement!
Click here to manually synchronize the status of this Pull Request.
See the FAQ for frequently asked questions.

@rumata28 Thank you for signing the Contributor License Agreement!


Revert "[macOS] Bring up "flutter_gallery" devicelab, start up test for x86."

Reverts flutter/flutter#110370
This closed the tree: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_android flutter_gallery_mac__start_up/3652/overview
I'm not sure why it broke Mac_android flutter_gallery_mac__start_up since the breaking PR added Mac flutter_gallery_macos__start_up.  Maybe a naming conflict?

I think renaming the task broke the other target which also depended on that file

as this is a revert on ToT to fix tree, merging before pre-submits finish.

https://github.com/flutter/flutter/pull/110370/files#r956438689

dev/devicelab/bin/tasks/flutter_gallery_mac__start_up.dart test was for Android Mac_android flutter_gallery_mac__start_up. The rename to flutter_gallery_macos__start_up.dart broke that test.
https://github.com/flutter/flutter/blob/4770e348595551832a4762ea0eabe2cca59b668c/.ci.yaml#L3084


Introduce classes for indexes and their accumulators

This pull request introduces type classes that provide a common interface to different types of indexes and their accumulators and instantiates these type classes for the compact and the ordinary index.

Keep the implementations for concrete  implementations of the index class and keep exporting them from the modules. We don't need the generality of the class in case we are testing/benchmarking concrete index types and their functions. Also, until we make the index selectable, using the concrete functions reduces the risk of missed specialisations.

Would you be okay with relying on specialization instead? I think that from a design perspective it’s better to not repeat APIs (and thus code, albeit only little of it).
Of course, we should have a clear approach for guaranteeing that specialization opportunities aren’t missed. From what I understand, an instance declaration introduces specializations for its method implementations. As a result, we should only have to make sure that the modules that use class methods for specific index or index accumulator types import the modules that declare these types (as these contain the corresponding instance declarations). However, this usually happens anyway. The current situation in this regard is as follows:

The benchmark and most of the tests that are about concrete index or index accumulator types are implemented in modules of their own. These modules necessarily import the modules with the corresponding type declarations, as they have to construct concrete indexes or index accumulators, either manually or via QuickCheck generators (in which case the type of the values to be generated must be explicitly specified).

The module Test.Database.LSMTree.Internal.Lookup, while not directly about indexes, imports the module Database.LSMTree.Internal.Index.Compact, because it has to explicitly specify the index type to be used for test runs.

The module Test.Database.LSMTree.Internal.RunAcc currently doesn’t import a module that declares the index and the index accumulator type it uses. However, this is just because the underlying Database.LSMTree.Internal.RunAcc module still uses IndexCompact and IndexCompactAcc unconditionally. When we change this module to use arbitrary index and index accumulator types, we will have to modify its new function such that it allows for the specification of an index accumulator type. The test module for RunAcc will then have to explicitly pick an index accumulator type and therefore pull in the module where this type is defined (which in turn pulls in the module that defines the underlying index type).

We seem to lose some documentation on concrete implementations for index class functions. Either we should keep some of that documentation, or explicitly link to where the new documentation can be found. And we should double check that we’re not losing any information in the process.

I think that I was very careful to not lose any information. My goal was to document things that are common to all types of indexes with the classes only. I can add references to this documentation from the modules about the concrete types wherever it is sensible.

I can add references to this documentation from the modules about the concrete types wherever it is sensible.

Done in 3141593ede80ab3ad5e649bdf0ece9286cd936ae.

Maybe as a middle ground, we could expose the class or the class functions from the concrete implementation modules. It also means you get the the full API if you import a concrete implementation module, and then you don’t have to import the general Index module as well.

Interesting idea.
Let me summarize the possibilities of what a module providing a concrete index type can export in terms of the general index operations:

Versions of the class methods that work for the concrete index type
The (polymorphic) class methods themselves (via re-export)
Nothing at all

Option 1 increases the risk of name clashes, which have to be resolved then, because there is a single name for a class method and its concrete versions. Option 2 makes the interfaces of the modules providing concrete index types self-contained, so that the general index module doesn’t need to be imported when working with just a concrete index type. Option 3 clearly separates the general interface from its concrete implementations.
I’m generally not a big fan of publicly visible re-exports. They mean that a single item is available from different modules, which not only makes the structure of the overall library interface more complicated but introduces the necessity for the library user to decide from which module to import a particular item.
That said, maybe option 2 is still an acceptable compromise in this particular situation. I think that I’ll go for it.

That said, maybe option 2 is still an acceptable compromise in this particular situation. I think that I’ll go for it.

I’ve made corresponding changes in 5b463fc18919b52db1a55884e86659de3b61fee9. I’ve also adapted imports of the modules that provide index support, but only imports into tests and benchmarks, not into other parts of the core library, because the latter are going to be made independent of index types anyhow.


Update on IISWebAppDeploy package version broke WinRM - SQL Server DB Deployment task on TFS 2018

Hello,
today something changed on the WinRM - SQL Server DB Deployment task (IISWebAppDeploy package) which causes errors on TFS 2018 that was correctly deploying Dacpac files to SQL Server until yesterday.
This is the version showed in log today (1.4.0)
Loading module from path 'E:\agent2018-01\_work\_tasks\SqlDacpacDeploy_063c7649-4934-49e8-9eac-37121fe7e350\1.4.0\DeploymentSDK\InvokeRemoteDeployment.ps1'.
This is the version showed in the log of the same distribution task runned yesterday (1.3.12)
Loading module from path 'E:\agent2018-01\_work\_tasks\SqlDacpacDeploy_063c7649-4934-49e8-9eac-37121fe7e350\1.3.12\DeploymentSDK\InvokeRemoteDeployment.ps1'.
Log of the error
2023-04-05T16:46:47.5412403Z ##[debug]Entering script DeployToSqlServer.ps1
2023-04-05T16:46:47.5412719Z ##[debug]machinesList = DEV-DB01.dev.loc
2023-04-05T16:46:47.5413034Z ##[debug]adminUserName = AGSDOM\svc_tfs
2023-04-05T16:46:47.5413292Z ##[debug]winrmProtocol  = Http
2023-04-05T16:46:47.5413559Z ##[debug]testCertificate = true
2023-04-05T16:46:47.5413812Z ##[debug]TaskType = dacpac
2023-04-05T16:46:47.5414138Z ##[debug]dacpacFile = C:\[redacted].dacpac
2023-04-05T16:46:47.5414430Z ##[debug]sqlFile =
2023-04-05T16:46:47.5414689Z ##[debug]targetMethod = server
2023-04-05T16:46:47.5414949Z ##[debug]serverName = [redacted]
2023-04-05T16:46:47.5415221Z ##[debug]databaseName = [redacted]
2023-04-05T16:46:47.5415483Z ##[debug]authscheme = Windows Authentication
2023-04-05T16:46:47.5415750Z ##[debug]sqlUsername =
2023-04-05T16:46:47.5415996Z ##[debug]publishProfile =
2023-04-05T16:46:47.5416899Z ##[debug]additionalArguments = /p:BlockOnPossibleDataLoss=False /p:DropObjectsNotInSource=True /p:DoNotDropObjectTypes=Logins;LinkedServerLogins;Assemblies;SearchPropertyLists;FullTextStoplists;Endpoints;PartitionSchemes;Users;FullTextCatalogs;Certificates;Contracts;Audits;SecurityPolicies;ExternalFileFormats;Filegroups;ErrorMessages;CryptographicProviders;ApplicationRoles;DatabaseRoles;ServerRoles;LinkedServers;Services;Synonyms;ClrUserDefinedTypes;UserDefinedDataTypes;MessageTypes;UserDefinedTableTypes;Aggregates;RoleMembership;ServerRoleMembership;RemoteServiceBindings;ServerTriggers;Permissions;AsymmetricKeys;ColumnMasterKeys;ColumnEncryptionKeys;SymmetricKeys;Queues;Credentials;DatabaseScopedCredentials;Signatures;PartitionFunctions;Defaults;EventNotifications;ExternalDataSources;BrokerPriorities;XmlSchemaCollections;Rules;Sequences;Routes;EventSessions;ServerAuditSpecifications;DatabaseAuditSpecifications
2023-04-05T16:46:47.5417772Z ##[debug]deployInParallel = true
2023-04-05T16:46:47.5418028Z ##[debug]inlineSql =
2023-04-05T16:46:47.5418301Z ##[debug]Triming inputs for excess spaces, double quotes
2023-04-05T16:46:47.5467992Z ##[error]System.Management.Automation.RuntimeException: Additional arguments can't include separator characters '&', ';' and '|'. Please verify input. To learn more about argument validation, please check https://aka.ms/azdo-task-argument-validation ---> System.Management.Automation.RuntimeException: Additional arguments can't include separator characters '&', ';' and '|'. Please verify input. To learn more about argument validation, please check https://aka.ms/azdo-task-argument-validation
2023-04-05T16:46:47.5478165Z ##[debug]Processed: ##vso[task.logissue type=error;]System.Management.Automation.RuntimeException: Additional arguments can't include separator characters '&', ';' and '|'. Please verify input. To learn more about argument validation, please check https://aka.ms/azdo-task-argument-validation ---> System.Management.Automation.RuntimeException: Additional arguments can't include separator characters '&', ';' and '|'. Please verify input. To learn more about argument validation, please check https://aka.ms/azdo-task-argument-validation
2023-04-05T16:46:47.5478692Z    --- End of inner exception stack trace ---
2023-04-05T16:46:47.5478911Z    at System.Management.Automation.Runspaces.PipelineBase.Invoke(IEnumerable input)
2023-04-05T16:46:47.5479168Z    at System.Management.Automation.PowerShell.Worker.ConstructPipelineAndDoWork(Runspace rs, Boolean performSyncInvoke)
2023-04-05T16:46:47.5479427Z    at System.Management.Automation.PowerShell.Worker.CreateRunspaceIfNeededAndDoWork(Runspace rsToUse, Boolean isSync)
2023-04-05T16:46:47.5479724Z    at System.Management.Automation.PowerShell.CoreInvokeHelper[TInput,TOutput](PSDataCollection`1 input, PSDataCollection`1 output, PSInvocationSettings settings)
2023-04-05T16:46:47.5480033Z    at System.Management.Automation.PowerShell.CoreInvoke[TInput,TOutput](PSDataCollection`1 input, PSDataCollection`1 output, PSInvocationSettings settings)
2023-04-05T16:46:47.5480320Z    at Microsoft.TeamFoundation.DistributedTask.Handlers.LegacyVSTSPowerShellHost.VSTSPowerShellHost.Main(String[] args)
2023-04-05T16:46:47.5485158Z ##[error]LegacyVSTSPowerShellHost.exe è stato completato. Codice restituito: -1.

Any hint on how workaround this error or rollback to the previous version?

I had this issue as well today, I was able to work around it by separating my "DoNotDropObjectTypes" into an entry for each, for example yours would need to be changed to:
/p:DoNotDropObjectType=Logins /p:DoNotDropObjectType=LinkedServerLogins /p:DoNotDropObjectType=Assemblies ... and so on.
Note: when you change the format like this "/p:DoNotDropObjectTypes" would need to be changed to /p:DoNotDropObjectType
Luckily, I was only protecting 5 or so object types, but I imagine with the amount of Object Types you have listed it would take a bit of time.
Hope this helps! and that it gets fixed soon!!


[DNM] enlarge raft base tick interval and make it configurable

@ngaut @BusyJay @hhkbp2

LGTM

PTAL @ngaut @BusyJay

LGTM


Concatenate partitions based on arbitrary large chunksize passed to dd.read_parquet

When calling dask.DataFrame.repartition and providing partition_size, this will trigger dask to load the actual data to determine the memory size of each partition, which is an expensive operation. This is needed to figure out the appropriate way of partitioning the dataframe.
However, for data that resides in Parquet, one does not need to read the actual file contents themselves. One could read the Parquet metadata (and use predicate pushdown) to determine the approximate size of partitions. This is something that we have recently implemented in kartothek (still in a somewhat experimental state). Such a computation is much cheaper than having to load the actual data because we only need to read the metadata of our partitions.
Instead of supporting this directly in dask.DataFrame.repartition it probably makes more sense to have this in dd.read_parquet (and the appropriate dask.bag method ?). We can already pass a target chunksize to dd.read_parquet but currently it will only concatenate row groups, so the resulting chunk size may be much smaller than the value that we have passed.

cc @rjzamora and @jorisvandenbossche who have been more involved with parquet refactoring

Thanks for opening this - I/we have certainly planned to improve the chunksize code path and include a better solution for aggregating both row-groups and/or files.  Since CuDF is capable of reading in list of small files efficiently, we are particularly interested in multi-file partitions in Dask-CuDF.
I'd like to focus on it after #6534 gets in.

Closing this since the requested feature was implemented in read_parquet. (Note: There are currently plans to deprecate this feature, but that shouldn't happen until similar functionality is captured in a new way).


Add Missing Methods for Notification templates

Some endpoints of the following section can't be hit from this SDK.
We would like to ensure that all endpoints can be hit. For this issue, we would like to build out the Notification templates
Some of these methods may already exist.
If so no need to change/update them, just point out that they already exist and we will close the issue.

This is just to bring every SDK we have on par with all the methods available.
Check all the endpoints here and add the missing ones.

@Cliftonz i will pick this up, none of the Notification API methods have been implemented

the swagger shows that its already deprecated and it appears to be renamed as workflows, so this becomes non-relevant

@srikanth597 Thank you for pointing that out. I have switch the name, if you finish the other issue and no one else has claimed this I will assign it to you.

@Cliftonz  Please assign me this issue

@Cliftonz I have already completed the other Issue, provided the PR reference, waiting for review & merge.
Which is why I was hoping i could do this in the meantime.
Since you have assigned this perhaps i will probably look for something else

Since it was un-assigned again, i have picked it up & raised the PR #68 for the same@Cliftonz


Clean up limitation enforment in Group.

@havardpe PR
@bjorncs This matches #26092

This extends the limits in the backend to unblock #26078


daedalus/attacks/Common Modulus Attack.py

Code goes into the files you're committing, not the comment on the PR.
All of the attacks go into daedalus/attacks, not outside of it. Please move it and re-raise a PR. (not just delete it).
 It took me a while to figure out that you had pushed to master directly.
You can trim down on the blank lines; there's no need for a blank line after every line of Python code. Too much whitespace makes it less readable.

Please follow these strictly before raising the next PR. Read this, and in particular, note how the comment is not the same thing as the code you're pushing.


Future config port

[ ] Changes comply with the maintainer guide.
[ ] The name of the port matches an existing name for this component on https://repology.org/ if possible, and/or is strongly associated with that component on search engines.
[ ] Optional dependencies are resolved in exactly one way. For example, if the component is built with CMake, all find_package calls are REQUIRED, are satisfied by vcpkg.json's declared dependencies, or disabled with CMAKE_DISABLE_FIND_PACKAGE_Xxx.
[ ] The versioning scheme in vcpkg.json matches what upstream says.
[ ] The license declaration in vcpkg.json matches what upstream says.
[ ] The installed as the "copyright" file matches what upstream says.
[ ] The source code of the component installed comes from an authoritative source.
[ ] The generated "usage text" is accurate. See adding-usage for context.
[ ] The version database is fixed by rerunning ./vcpkg x-add-version --all and committing the result.
[ ] Only one version is in the new port's versions file.
[ ] Only one version is added to each modified port's versions file.

@microsoft-github-policy-service agree

Note: I will be converting your PR to draft status. The above suggested changes are only recommendations. If you are willing to adopt them, please click "ready for review" after making the modifications. If you do not wish to make any changes, please click "ready for review" directly. That way, I can be aware that you've responded since you can't modify the tags.

Hi, what should I do next? I think the PR is ready to review. Some pipelines are failing, but this is due to an unsupported compiler...

If your port does not support certain platforms, you can add "supports":"!linux" in vcpkg.json to restrict it. Please refer to vcpkg supports for usage.

If your port does not support certain platforms, you can add "supports":"!linux" in vcpkg.json to restrict it. Please refer to vcpkg supports for usage.

Ok, thanks! And what can I do if the platform is supported but a newer version of the compiler is required? Is there a tag for that? Or should I rather invest time to provide alternative compilation for older compilers?

what can I do if the platform is supported but a newer version of the compiler is required?

In that case "supports": "!linux" is wrong. You would need to add future-config:x64-linux = fail to scripts/ci.baseline.txt.
For vcpkg users, an actual solution might be more helpful (and it would also enable vcpkg CI).


Shader rendered with darker background and blue patch on addition of unreachable returns

[Shaders, screenshots, error log, reproduction steps, platform info, etc.] [ZIP]
Recipient:

Variant 1:

Variant 2:

WebGL viewer for recipient:
http://htmlpreview.github.io/?https://github.com/mc-imperial/shader-compiler-bugs/blob/master/NVIDIA-770-WebGL-ANGLE/wrong_images/slug/webgl_viewer_recipient.html
WebGL viewer for variant 1, which has two unreachable return statements:
http://htmlpreview.github.io/?https://github.com/mc-imperial/shader-compiler-bugs/blob/master/NVIDIA-770-WebGL-ANGLE/wrong_images/slug/webgl_viewer_variant1.html
This cause a darker background and a blue patch to appear.
WebGL viewer for variant 2, which has just one unreachable return statement:
http://htmlpreview.github.io/?https://github.com/mc-imperial/shader-compiler-bugs/blob/master/NVIDIA-770-WebGL-ANGLE/wrong_images/slug/webgl_viewer_variant2.html
The background is still darker, but there is no blue patch.
Platform details:

Windows 10
Google Chrome Version 57.0.2987.110 (64-bit)
NVIDIA GeForce GTX 770
Driver version <IP_ADDRESS>78

This does not appear to be an ANGLE bug as it does not repro on an Intel GPU on a Windows platform with the same Chrome version.

Did not observe differences between the recipient and two variants on:

Firefox on Archlinux running Mesa 13.0.3 on an Intel i7
Firefox on Ubuntu 16.10 running Mesa 17.0.1 on an AMD R9
Chrome and Edge on Windows 10 running Radeon 17.2.1 on an AMD R9 Fury

We haven't yet reported this one.


add overwrite:true to renameAndMoveFile

Closes #55

Thanks for the fix! read contribute code to understand how releases work... basically your commit should have been added with a tag followed by the description so semantic triggers a release. fix: add overwrite:true to renameAndMoveFile
Could you amend your commit and add that prefix please? @kevinsperrine

@PippoRaimondi amended and re-pushed. Sorry about that. Let me know if there's anything else I need to do.

:tada: This PR is included in version 1.15.9 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Docker image gitea/gitea:1 regressed from 1.15.0 to 1.14.7

https://hub.docker.com/layers/gitea/gitea/1/images/sha256-f8b9adeb25bfec817008d07b0eb7b92740a48e2b51834fc8c6ff86a0943afc95?context=explore
Todays release caused gitea to fail to start and spin
Downgrading database version from '189' to '178' is not supported and may result in loss of data integrity.
If you really know what you're doing, execute `UPDATE version SET version=178 WHERE id=1;`
Received signal 15; terminating.

I would assume that the 1 tag is only "latest stable" releases, with monotonic versioning, and any additional LTS releases don't get pushed to that tag. Doing that doesn't break the assumption that pulling every 1 tagged image should work. I assume that the same release procedure is used for both "stable" and "lts" releases, hence the overwriting of the 1 tag.
If there are no worries, can I ask that the 1 tag is restored to 1.15.0 please?

Can confirm the issue, not sure what to do about this.
Any help/guidance from maintainers would be awesome.
Thanks.

It's due to how CI tags images. 1.15.1 was just tagged/pushed, and will write the expected version to :1
If you wait 30 minutes the CI will put the expected image in place. We very rarely tag a version below current stable, and when we do we tag a newer one so that the CI will resolve the issue.


Attempt to fix styling issues with lists

Attempt to resolve #273 by adding inherit for ol & ul in the style.css for Gitbook (added at the end of the minified code: ul ol{list-style:inherit}) - I think this should work but don't know how to render locally to double-check.  It seems that the WP theme is setting the list-style to none so hoping this might resolve the problem.

Based on my test of the code change you've suggested in the dev tools it should show the bullets now. This change may be removed once the less files will be rebuilt. I'm not sure if they are during deployment. Let's see.

I was trying to figure out where the less files were to make the changes there but wasn't able to find them! Entirely possible I was looking in the wrong place!


Support for Django 5.1

@kimihito Thank you! I plan on merging this in this weekend when I publish a small update to fix the readme on pypi and get GitHub actions working.

+1

What's the status of support for Django 5.1?
I'd very much like to know about a version that can use the database adjustments added in that version.


Use more formal/complete HSTS parser

Ideally, there would already be a good tested Python library for doing this.
For reference, here's the parser I wrote in Ruby (with careful attention to the HSTS RFC):
https://github.com/benbalter/site-inspector/blob/erics-mode/lib/site-inspector.rb#L28-L84

Some examples of pathological HSTS situations as I find them:
$ curl --head --header "User-agent: Hey there" https://telework.govHTTP/1.1 200 OK
Server: Microsoft-IIS/6.0
X-UA-Compatible: IE=edge
X-Powered-By: ASP.NET
Origin-Server: www1
Origin-Loc: m
Content-Type: text/html; charset=utf-8
Content-Length: 32104
X-XSS-Protection: 1; mode=block
X-Content-Type-Options: nosniff
x-frame-options: SAMEORIGIN
Strict-Transport-Security: max-age=31536000
X-XSS-Protection: 1; mode=block
X-Content-Type-Options: nosniff
x-frame-options: SAMEORIGIN
Strict-Transport-Security: max-age=31536000
Cache-Control: private, max-age=45689
Date: Thu, 18 Aug 2016 16:21:40 GMT
Connection: keep-alive
X-XSS-Protection: 1; mode=block
X-Content-Type-Options: nosniff
x-frame-options: SAMEORIGIN
Strict-Transport-Security: max-age=31536000

$ curl --head --insecure https://jamesmadison.gov
HTTP/1.1 200 OK
Date: Thu, 18 Aug 2016 17:45:09 GMT
Server: Apache
Vary: Accept-Encoding
X-SA-Server: 1.apache.prod
X-Content-Type-Options: nosniff
X-XSS-Protection: 1; mode=block
Strict-Transport-Security: includeSubDomains
Connection: close
Content-Type: text/html; charset=UTF-8

Here are the test cases I wrote for site-inspector that I would want to reproduce in a unit test suite here:
https://github.com/benbalter/site-inspector/blob/erics-mode/test/test_hsts.rb

$ curl --head https://www.bnl.gov
HTTP/1.1 302 Moved Temporarily
Cache-Control: Private
...
Strict-Transport-Security: 'max-age=10886400'

$ curl --head https://www.bop.gov
HTTP/1.1 200 OK
...
Strict-transport-security: max-age=31536000; includeSubDomains; preload

$ curl --head https://www.fdic.gov
HTTP/1.1 200 OK
...
Strict-Transport-Security: max-age=157680000

Just flagging that the priority here is higher, as fdic.gov is causing a crash during long-running scans.


error with the python code

Error: bad marshal data (unknown type code)

I also get this, please fix! @TermuxHackz


Scumblr Email notifications not working

I performed searches which has results related to a saved filter, and I added my email in subscribers but I don't receive email notification.
I am beginner in this so I haven't made any configurations for mail except the following:

nano Scumblr/config/environments/production.rb

_

config.action_mailer.delivery_method = :smtp
config.action_mailer.smtp_settings = {
address: 'smtp.gmail.com',
port: 587,
user_name<EMAIL_ADDRESS>password: 'email password',
authentication: 'plain',
enable_starttls_auto: true }

Disable delivery errors, bad email addresses will be ignored
config.action_mailer.raise_delivery_errors = true
config.action_mailer.perform_deliveries = true
config.action_mailer.default_url_options = { :host => "localhost:3000", :protocol => 'https' }
config.action_mailer.default_options = {from: 'no<EMAIL_ADDRESS>

Did you also run the rake task to send out notifications? Are you sure you're running your application (and the rake task for that matter) in the production environment (default would be development).

I tried both rake sync all and rake send_email_updates none of them worked but no I didn't change the environment from the default.

So I would try applying the config updates to config/environments/development.rb. Then run rake tasks:
RAILS_ENV=development rake sync_all
RAILS_ENV=development rake send_email_updates

Your searches will need to find new results of course. Try the above and let me know what the output looks like.

I tried it and received an email with the results

Good, glad it's working.


ExtraSpaces

Added missing space and :

@NaomiN : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Looks good. Thanks @NaomiN


Breadcrumbs

Missing this great feature from the RN implementation. JS client has it and it's really good for tracking down bugs. Thx!

Hey,
I am currently working on this PR
https://github.com/getsentry/react-native-sentry/pull/26
Which should bring all the features raven-js had and combine it with our native client ...
Stay tuned, scheduled release -> next week


Model zoo (fix #3)

This PR fixes #3 by adding functions.caffe.CaffeFunction, which loads a pretrained Caffe model and emulates its subnetwork. The usage is written in the reference documentation, though I also show it here. This is an example of loading BVLC reference CaffeNet and computes fc8 blob from data blob.
# Load the model
func = CaffeFunction('path/to/bvlc_reference_caffenet.caffemodel')

# Minibatch of size 10
x_data = numpy.ndarray((10, 3, 227, 227), dtype=numpy.float32)
...  # (Fill the minibatch here)

# Forward the pretrained net
x = Variable(x_data)
y, = func(inputs={'data': x}, outputs=['fc8'])

The inputs dict describes how to initialize the blobs by variables. The outputs list indicates which blobs to be output as variables. Also user can extracts parameterized layers from CaffeFunction.fs, which is a FunctionSet object containing Linear or Convolution2D objects.

Do you have a unit test for this function?

I'm thinking about the test, though I have no good plan, yet.

I'll write an example of loading and using a Caffe reference model.

I added an example. However, it outputs too low accuracy. I will try to resolve this issue.

I updated the example code.

I updated the code. It achieves the same accuracy as the original Caffe implementation.

Please chmod +x download_model.py

I added a warning routine on unknown layer types.

I load my caffemodel and then Traceback ZeroDivisionError as:
File "", line 1, in
File "chainer/functions/caffe/caffe_function.py", line 119, in init
meth(self, layer)
File "chainer/functions/caffe/caffe_function.py", line 228, in _setup_convolution
nobias=not param.bias_term)
File "chainer/functions/convolution_2d.py", line 92, in init
0, wscale * math.sqrt(1. / (self.kh * self.kw * in_channels)),
ZeroDivisionError: float division by zero

@itortoise Thank you for reporting an error. Would you open another issue for this?

@itortoise #148 may fix your problem.


Pathfinder

updated formatting on version info
date change in footer

You're too fast Riley.  ;-)
But Don't stop.  Thanks

This is like a game.  Who can update faster...

I merged these updates in the pathfinder-neceros.html file with my PR #1234
So you can just use my pathfinder-necros.html file from that PR, and don't try to merge them yourselves, since we already did it.
Other files in 1233 here i did not touch.


Question or bug in ConsulDiscoveryClient class

When the isPreferIpAddress is set to true, the address of the service is retrieved using the service.getAddress instead of service.getServiceAddress. So the address that is returned is the consul server instead of the service's server.
    private void addInstancesToList(List<ServiceInstance> instances, String serviceId) {
        Response<List<CatalogService>> services = client.getCatalogService(serviceId,
                QueryParams.DEFAULT);
        for (CatalogService service : services.getValue()) {
            String host;
            if (this.properties.isPreferIpAddress()) {
                host = service.getServiceAddress(); // REPLACED
            } else {
                host = service.getNode();
            }
            instances.add(new DefaultServiceInstance(serviceId, host,
                    service.getServicePort(), false));
        }
    }

@jmirc when I run locally, serviceAddress is empty.

Even the docs have it empty.  Maybe it should be?
if (prefer ip address) {
  if (serviceAddress is not empty) {
    host = serviceAddress;
  } else {
    host = address
}

@spencergibb We are using a cluster of consul and the serviceAddress is not empty.
I think your solution seems to address the problem.


update to 2.9.1

Testing...

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

R 3.3.2 is failing on OS X. Merging this to get the rest in the channel and we can try to figure it out later. (If we still care about R 3.3.2)


Question:  FitHorizontally, but display top row of images

I am using the full multi image functionality in version 2.1.  I have multiple images that are arranged in a grid (see example on issue 665).
  What happens when I have many images is that some of the images on top aren't visible and some on the bottom of the display aren't visible.   I'm guessing that OpenSeadragon calculates the center of my block of images and then fits the display horizontally around that point.
FitVertically displays the block of images - in that case, I wind up with margins on both sides of the image block.  (Which is expected behavior as well.)
Is there a way that I can tell FitHorizontally (or some other method) to do what FitHorizontally is doing, except, I want to see the first row of images aligned along the top of the viewport?   There must be some way I can get the current center, and pan to the top - but what are the necessary calls to make that calculation happen?
Thanks!

We don't have a function like that (though it might be a good thing to add). Meanwhile, the general procedure is to pick the rectangle that shows what you want and then viewer.viewport.fitBounds(rect) with it. For example:
var viewportBounds = viewer.viewport.getBounds();
var viewportAspect = viewportBounds.height / viewportBounds.width;
var newBounds = viewer.world.getHomeBounds();
newBounds.height = newBounds.width * viewportAspect;
viewer.viewport.fitBounds(newBounds);

(I didn't test the code above, but it's the right general ballpark.)

Just to make sure I'm not being short sighted on this, could you take a look at the following?  It's similar to what you have, and in a couple of tests, it's doing what I want it to do - but don't want to have it bite me when I didn't think of scenarios you might think of.
     homeBounds = viewport.getHomeBounds();

    var box = viewport.getHomeBounds();
    box.x = homeBounds.x;
    box.y = homeBounds.height / 2;
    box.width = homeBounds.width;
    box.height = 0;

    viewport.fitBounds(box, true);

This performs the fitHorizontally functionality like I want, but slides the block of images up to the top of the viewport.

So you're creating a 0 height rectangle that spans from the left of the content to the right of the content and is centered vertically on the content. I'm actually surprised it's doing anything different than fitHorizontally does. At any rate, try it with a number of different content sizes and viewer aspect ratios. Make sure it works with a tall viewer and with a wide viewer. If it works how you like in all those scenarios, then you're set. If not, you might try introducing the viewer aspect ratio into your code like I did above.

I'm back to letting OpenSeadragon do it's layout functionality using the homeFillsViewer true/false setting.
Occasionally, I'm getting initial views that seem off center.      I'm evidently doing something that offends OpenSeadragon, I just can't see what it is.  This doesn't appear to happen when I have many rows of images, just in situations like the following where I have a couple of images.
The following data is an example of what is really causing some problems.
When homeFillsViewer = false, I get what almost appears to be a fitHorizontally result. Images are vertically centered, and zoomed to fill the viewer horizontally.   When homeFillsViewer = true, the images expand beyond the bounds of the viewer horizontally and vertically.   The goal here is to have the height of the 2 images be the same and let the width adjust accordingly.
Here is the initial setup for OpenSeadragon:
OpenSeadragon({
        id: configMap.containerElementName,
        clickToZoom: true,
        pinchToZoom: true,
        debugMode: false,
        flickEnabled: true,
        homeFillsViewer: true,
        //homeFillsViewer: false,
        showFullPageControl: false,
        minZoomImageRatio: configMap.minZoomImageRatio,
        //maxZoomLevel: configMap.maxZoomLevel,
        maxZoomPixelRatio: Infinity,
        maxImageCacheCount: 500,
        gestureSettingsMouse: { clickToZoom: false, pinchToZoom: true },
        gestureSettingsTouch: { clickToZoom: false, pinchToZoom: true },
        viewportMargins: { left: 2, top: 0, right: 2, bottom: 0 },
        prefixUrl: configMap.overlayImagePath
    });

The json for the 2 elements:
[{
"tileSource": {
	"Image": {
		"xmlns": "http://schemas.microsoft.com/deepzoom/2009",
		"Url": "http://somewhere.com/over/the/rainbow/",
		"Format": "jpg",
		"Overlap": "1",
		"TileSize": "256",
		"Size": {
			"Height": "400",
			"Width": "400"
		}
	}
},
"x": 0,
"y": 0,
"index": 0,
"height": 0.4375,
"userData": "userData1"
},
{
"tileSource": {
	"Image": {
		"xmlns": "http://schemas.microsoft.com/deepzoom/2009",
		"Url": "http://somewhere.com/beyond/the/rainbow/",
		"Format": "jpg",
		"Overlap": "1",
		"TileSize": "256",
		"Size": {
			"Height": "3584",
			"Width": "4608"
		}
	}
},
"x": 0.4375,
"y": 0,
"index": 1,
"height": 0.4375,
"userData": "userData2"
}

Thanks for taking a look.

I'm afraid I'm having a hard time visualizing this. Is it possible for you to make a Codepen or something to show it in action?
At any rate, homeFillsViewer was never designed with multi-image in mind; to support all the possible multi image needs would probably require a new API. Can you tell me why my suggestion above for how to create an initial selection isn't working for your needs?


Niyati

Hi! May I ask the purpose of this Pull Request? The README you added implies it is an extension, perhaps you mean to open a PR to your own fork?


Add declare-styleable tag to README sample

It wasn't entirely clear to me so figured it'd be useful to others

Hmmm, I thought this was kind of implicit, but I guess maybe not. I'll add it though, thanks!


Train loss NaN when previous QA is set to 0

When I set previous QA to 0 in conf, the train loss met nan. How can I solve it?

It may happen that certain weights get very large. Try using smaller gradient clipping (like 1, 0.1).

It may happen that certain weights get very large. Try using smaller gradient clipping (like 1, 0.1).

@zcgzcgzcg1 Thanks for your reply. But it doesnt work according to your suggestion (gradient clipping 1, 0.1).


Yii2 filter validator doesn't allow array.

It will be great if you add this feature
E.G
  ['label', 'filter', 'filter' => ['trim', 'strtolower']]

You can use several consecutive validators in a row
 ['label', 'filter', 'filter' => 'trim]
 ['label', 'filter', 'filter' => 'strtolower']

@dmirogin  I know , but it will be easy to define all filters in one array.

Arrays are valid callables so it's not possible to determine if it's object-method pair or two separate methods. See https://secure.php.net/manual/en/language.types.callable.php
Won't introduce it for the sake of not being ambiguous.


Fix: Fixed build pipeline certificate

Resolved / Related Issues
Items resolved / related issues by this PR.

Fixed build pipeline certificate

Validation
How did you test these changes?

[x] Ran the pipeline

Screenshots (optional)
Add screenshots here.

@chingucoding besides the cert, anything else that needs to be modified?

Looks like that fixed the issue, thank you!


Read the latest consensus state

Inside the requirements, there's the following:

Read the latest consensus state

@kwunyeung can we more details on what you mean by "consensus state"?

I'm referring to the state of the consensus being made,

which can be monitored from the Tendermint RPC /dump_consensus_state or they can be subscribed by these events.
We can discuss how this can be done. I prefer getting this in the backend so that the node being monitored won't have large requests from the frontend. And the frontend can only query the data from GraphQL. It will be great if those events can be mapped as subscriptions on Hasura. We may don't have to store the data in PostreSQL if Hasura let us create custom logic which can get the data from the Tendermint events.

Maybe put this on hold first. I will see if subscribing the events from frontend will have better UX. It may not really taking too much resources. If we have so many users subscribing the events simultaneously, it will be a happy problem.

[...] they can be subscribed by these events.

Are you referring to all these events?
	EventCompleteProposal = "CompleteProposal"
	EventLock             = "Lock"
	EventNewRound         = "NewRound"
	EventNewRoundStep     = "NewRoundStep"
	EventPolka            = "Polka"
	EventRelock           = "Relock"
	EventTimeoutPropose   = "TimeoutPropose"
	EventTimeoutWait      = "TimeoutWait"
	EventUnlock           = "Unlock"
	EventValidBlock       = "ValidBlock"
	EventVote             = "Vote"

Yes these are the consensus state of a certain block height, which refer to the 6 steps of the Tendermint consensus.

@kwunyeung Between all of those 11 event types, what are the real important ones?

I think these
EventCompleteProposal = "CompleteProposal"
EventNewRound         = "NewRound"
EventNewRoundStep     = "NewRoundStep"
EventPolka            = "Polka"
EventValidBlock       = "ValidBlock"
EventVote             = "Vote"


Release 0.11

I have just released Specs 0.11-alpha1. It's an alpha release because a couple of breaking changes were introduced and docs haven't been updated yet. This issue lists what's missing for a full release.
Specs 0.11 will likely be the last release before Specs 1.0, so I'm hoping to finalize API design and remove the inconsistencies.
Fetch and Read
Fetch / FetchMut no longer implement SystemData, now users should use Read for values with default, Option<Read> for optional ones and ReadExpect for required resources (if a resource is not there, there'll be a panic - which is much better than in previous versions). For mutable access replace Read with Write.

[ ] Update all occurences of Fetch and FetchMut to take this into account

[ ] ...in the book
[ ] ...in the crate docs

Tracked API
The problem
Synchronizing components over the network, transforming components A to B and keeping them updated, instantiating an object hierarchy when a gltf file handle is placed on an Entity - all these are tasks that can take advantage of meta data: which components have been

inserted,
deleted and
modified.

This was impossible or pretty complicated in the past. One of the biggest problems was that there was no good time to clear the flags - you could easily miss a flag in the following scenario:

system A - consumes flags
system C - consumes a flag
system D - clears flags

If somewhere between A and C a flag gets set, A won't get that information with a bitset.
The solution
We're now using shrev-rs and store an event buffer for each channel (insertions, deletions, modifications). shrev uses a circular buffer with support for immutable reads. This way we make sure each system gets all the events.

[ ] Try out the new API, collect feedback and revise everything

Module structure
Items got more and more over time so we decided to not export everything at the crate root any longer. I think they're sorted into modules in a quite logical way and prelude contains the most important ones.

[ ] Collect feedback and revise the decision

Allow getting multiple components mutably
Issue: https://github.com/slide-rs/specs/issues/336
(Incomplete) PR: https://github.com/slide-rs/specs/pull/366

[ ] Get issue https://github.com/slide-rs/specs/issues/336 closed

Add wasm support
Open PR: https://github.com/slide-rs/specs/pull/353
It'd be nice to get wasm support directly in rayon (of course only for the functions that are supported). We should also consider to just wait until we have native support.

[ ] Ensure wasm support and make sure the API can always be the same - including for ParJoin

Meta

[ ] Update the changelog

That's all I could remember, maybe I'll add some more sections here. Help and feedback are very much appreciated!

Regarding the prelude module, is there any conventions for this that popular crates follow?
The diesel crate (rather big covering a lot of types) for instance has a prelude module, which is also re-exported with a pub use prelude::* in the root, so they actually offer both diesel::* and diesel::prelude::* as handy globs for the users, with the difference of the latter not including the namespaces of pub mods in the root. That could be a good fit here too I think.
Personally though, I tend to make my own preludes in projects and try not to rely on glob imports from crates when they reach beyond the prototyping phase, but they are very handy when learning a new lib.
Haven't been using the crate for more than a week or two, but I'm enjoying it quite a lot! Great work!

Thanks for your input! Personally I also avoid glob imports and since IntelliJ has auto imports now that doesn't slow me down.
Not sure how useful the items are at the crate root, you can just include them from the prelude or the specific modules.

It may be less of toe stub for new users, mostly. (And I would save some very valuable key strokes when writing my own preludes, specs::Entity instead of specs::prelude::Entity :smile: (granted the new nested use statements solves that too)).
It's not a big gain, but I also don't see a downside to letting a user chose.

Okay, let's see ^^
What do you think @Rhuagh @Xaeroxe ?

I don't care a ton, as I don't typically glob anyways, but specs::* does sound like it could make my life a little easier.

I usually export everything at crate root, and add preludes for common combinations, but I have no religious opinion

@Zoomulator If you submit a PR reexporting the prelude items at the crate root I'd be happy to accept it. Please don't use a glob import for it, but list them individually.

I would love to get Specs ready this week :)
You can help out:

[ ] several book improvements should be checked / fixed: #376
[ ] the above request for reexported items needs to be addressed
[ ] two "good first issues" that should go into 0.11: #393 #388
[ ] help @tversteeg to get https://github.com/slide-rs/shred/pull/84 ready

Please be sure to include your change in the changelog. Thanks!


Interface should allow zooming in and out

It would be nice to allow increasing, or decreasing, the text size of the interface

mixed feelings here.
I don't know of any other desktop app that allows this behaviour. at most they usually have a "font scale" slider in the settings.

I tested Slack, Discord, and the Spotify desktop apps and all three allow to increase and decrease the font size with "Ctrl +" or "Ctrl -" bindings without going to the settings
This came up when I was screen sharing something and wanted to increase the font size so it would be easier to see

ah, you're right. I thought I tried yesterday, but turns out I was typing the wrong shortcut.
nevermind then, I guess we can mimick their behaviour then

this is perhaps easier now with tailwind

@mimisavage yes, go ahead. when can you have something ready?


Removed report for others popup screen

Description
Hopefully I didn't get the wrong end of the stick on this @selvach  - I've removed the "report for others" interstitial and code entirely. We may want to boost the prominence of the "report for others" on the thank you page as a result? (see screenshot)
On what platform have you tested the change?

[ ] Android - Emulator
[ ] Android - Physical device
[x] iOS - Emulator
[ ] iOS - Physical device

Screenshots

Checklist

[ ] I have updated mockServer
[ ] I've added analytics as relevant
[ ] I have run npm test
[ ] I have run npm run test:i18n

Out of scope and potential follow-up
Is there any related changes that you plan to do in a follow-up PR or voluntarily excluded from the scope?

Looks good Ben! So nice to delete some code :)
I do not think think there is anything to clear up on the backend?


worker: header-based authenticator

With the following [authenticator] configuration,
[authenticator]
type = "header"
  [authenticator.header]
  name = "X-Remote-User"

worker will trust this header, and take its value as the authenticated
user's ID.
An example use case of this feature is a service setup where an upstream
service already checks authentication, and passed that along in a
request header. Of course, incoming requests (edge of the service
network) will need to have that header stripped.
Real-world examples are Kubernetes' Authenticating Proxy, see here:
https://kubernetes.io/docs/admin/authentication/#authenticating-proxy

Very elegant Mr. Renatus.

Moved: https://github.com/chef/foulkon/pull/1 ✅


Support Auth0's Authorization Extension

Would be nice if I could control my roles/permissions/groups and user assignment via terraform.

Unfortunately these days I'm pretty swamped and wouldn't have the time to implement new features for this extension. Would be happy to accept a PR though if you are up for it :)


API sometimes returns 502 for /schedule query on valid stations

Example: comparing these:
/api/station/M21
vs
/api/schedule/M21

Apparently this happens most frequently when the queried route/station doesn't have any scheduled departures


Any way to generate wasm_bindgen libraries?

I would like to have a rust wasm file be a library which can be called into via JS, instead of it being automatically executed.

@iMplode-nZ hello. If your primary use case is not with Rust WASM as the application entrypoint, and instead you just want a Rust WASM library, then https://github.com/rustwasm/wasm-pack is definitely what you are looking for. Their use case is more of a "JS first" approach, where Trunk is Rust WASM first with JS as a secondary facet.
Does that match what you are looking for?

Well I'm doing Rust WASM first, but I need multithreading

Gotcha. That being the case, I'll mention that we have an incomplete feature for being able to declare and use Rust WASM web workers.
Any special requirements? We don't get a lot of requests for this, but now that another has come through, might be time to knock it out.

It would be nice to have a simple "spawn thread" button under a feature, like std::thread. That might be rather difficult though.

Also by the way, would it be possible for the WASM web workers to have some sort of channel to send JS objects through?


bug: fix gotpl with or function

Description
Corrects gotpl syntax to use or as a function.
Why is this needed
In the 0.71.1 release of hugo there was a change that broke older compatibilities with gotpl.
Fixes: #133
How Has This Been Tested?
I ran the site in a container locally
docker run --rm -it -v $(pwd):/src \
     -p 1313:1313 klakegg/hugo:0.82.0-alpine server

Then I manually tested functionality of the site; link, copy text boxes, top nav, side bars, etc.
How are existing users impacted? What migration steps/scripts do we need?
Fixes a bug that prevented upgrading the site release to hugo v0.82.0 or latest.
Checklist:
I have:

[ ] updated the documentation and/or roadmap (if required)
[ ] added unit or e2e tests
[ ] provided instructions on how to upgrade

lgtm, tested with nix-shell's hugo and the updated docker image

/shrug, guess I don't have approval perms here.

when someone from @tinkerbell/devrel has a moment, would they mind looking at this, please and thank you :)


i get items randomly when create a world

Information

Server version: 1.16.3

Full output of /mv version -p: https://paste.gg/37d6496c8121462bbdcf517c5de05662

Server log: https://gist.github.com/xuso5556589/2895d951dd983d9d4ba378c310100268

Help request
Problem
i'm getting item all the time when i create a world  or i import or i clone whatever i do with multiverse i get items randomly on my inventory
What I have tried

Screenshots

multiverse-core alone doesn’t touch inventories, so inv will also be share among all worlds. Can you try with only mv plugins installed on the latest version of paper?

someone on discord told me can be for datapacks but i need those datapacks and i have one world called world with a datapack, but if i create another world should happen right?

Datapacks are applied globally on all worlds, and out of mv control. If you remove the datapack and the issue is fixed, then you have to find another datapack or plugin as alternative. Nothing mv can do about it.


[Regex] Infer 'Match' type of regex literals.

Applies apple/swift-experimental-string-processing#68 in regex literal type inference. Regex literals with captures will have type Regex<Tuple{n}<Substring, {Captures...}>>. This is a temporary thing that allows us to define generic constraints on captures. We will switch back to native tuples once we have variadic generics.

apple/swift-experimental-string-processing#68
@swift-ci please test

Note: This should not be merged until we have next tag (dev/6) in the string processing repo.

Build failed
Swift Test Linux Platform
Git Sha - db93ec98452e27c4356fdf6c8a4f5547eafcdec4

@swift-ci please test

@swift-ci please test

@swift-ci please smoke test and merge

Build failed
Swift Test OS X Platform
Git Sha - e5175d595e7ee38fdeff5a412e01a2e6105df3c4


Rootless podman ps segfault on refresh when containers are present

Is this a BUG REPORT or FEATURE REQUEST? (leave only one on its own line)
/kind bug
Description
Segfault stack trace: https://paste.fedoraproject.org/paste/ClFhuW2MYXIW2qESPyQ4Mg
When rootless podman runs the refresh command when containers are present, it will segfault.
Nearest I can tell, the sequence of events goes like this:
Podman's main creates a fresh libpod.Runtime to search for user namespaces to join
We haven't joined a user namespace yet, so GetEUID() != 0, so the storage.Store is not configured
A refresh is requested, so the code attempts to call into the store to create the container's temporary directories. The store has not yet been configured, so we segfault. Podman becomes unusable because refresh is impossible.
We need to do a refresh, though. Otherwise we won't properly reset container states after reboot.
Steps to reproduce the issue:

Create at least one container e.g. podman create -t -i fedora bash

Reboot the system

Run any podman command that is not podman version

Describe the results you received:
Podman segfaults
Describe the results you expected:
Podman does not segfault
Additional information you deem important (e.g. issue happens only occasionally):
Output of podman version:
Current master on F29, originally noticed with Rawhide packages

@giuseppe PTAL

I've opened a PR here: https://github.com/containers/libpod/pull/2896


SAK-318616 - primary-color-shadow should be dynamic

LGTM .   CC: @SedueRey

Great. LGTM

Too much numbers in this jira ticket, could you please change the commit message to SAK-31816?


NAF Implementation not working!

The NAF algorithm does not work on Pendulum or any of the PyBullet environments. @ikostrikov Do you have any guesses why that might be the case? Which environments did you experiment with this code on? In case you used different hyperparameters than the default values, could you mention the changes that need to be made to get the NAF algorithm working.

NAF might be a little bit outdated (I'm not planning to maintain this repository).
Is there a specific reason to use NAF?
I personally find it easier to tune soft actor-critic on new tasks and there is a bunch of well tested SAC implementations available. For example:
https://github.com/denisyarats/pytorch_sac
or
https://github.com/ikostrikov/jax-rl

I am working on an extension to NAF, so was am looking for a stable NAF implementation.


[LG] Add jpath prebuilt function

Filing this ticket to track work to add a jpath prebuilt function.
jpath(object, ‘jpath’)

Given the new adaptive style memory scopes, this is critical to land in 4.6.


Selective sync option?

Dear @nero120,
Remembering https://github.com/xBrowserSync/App/issues/1, how about an option to specify the root bookmark folder to sync? :-)
Yours,
Robert

Alright, that sounds great!
Let me know whenever I can help :-)
On Thu, Mar 9, 2017 at 1:53 PM Rich<EMAIL_ADDRESS>wrote:

Hi Robert, sounds fair enough in theory, though a bit more complex in
order to ensure support across Chrome and Firefox that use different
bookmark structures. I'll have to have a think about how it might be best
implemented.
I'm just in the process of putting the finishing touches to the mobile
apps, then I want to get Firefox support finished off as v52.0 is about to
be released that supports the required Web Extension APIs. Once that's done
I'll see what bugs and new features can be picked up for the next release.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/xBrowserSync/App/issues/3#issuecomment-285343359, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAKbw6HQsA6dqXN_WZ1jo7aS9aQfXzpEks5rj_YxgaJpZM4MXQfC
.

Any news on this, @nero120? :-)

In the process of adding Firefox support for the next release, so no progress on this request as yet. After thinking about it over the last few days, it does seem a bit counterproductive to implement a complex feature like this when the real issue is due to the limit on free sync space.
This could be solved much more easily by upping the limit to 5MB per sync (currently 500KB), but then the app would not be able to support many free users (the server/disk usage is not free and currently I eat the cost). Perhaps a better compromise would be to offer a paid option if you'd like to have a bigger sync size?

Perhaps a better compromise would be to offer a paid option if you'd like to have a bigger sync size?

Like the idea! How much would that be, roughly?

Good question! Let me have a think about how I'd implement it and check the hosting costs and get back to you.

Right @orschiro, how about this. $1 (USD) / month for a maximum sync size of 1GB. Subscription will be via Patreon (I'll create an xBrowserSync Patreon account) to save me having to manage accounts/payments. There will be some caveats however:

The subscription will be per sync ID (easier to manage max sync size for a given ID)
This will obviously affect anonymity aspects of the service, though I will still endeavour not to store any personal information within the xBrowserSync system. Your personal/payment data will be stored on Patreon along with the sync ID you are using, and xbs will check subscription data via Patreon's APIs (I still need to confirm exactly how this will work but I think it's possible in theory).

Providing this functionality will take a bit of time for me to build but I'll aim to release it along with the Firefox support in the upcoming release.
What do you think?

Sounds good to me! Shall we share the link to this issue thread to Reddit
and the like to get a feeling for how many people would support such a
Patreon campaign?
El 10/10/2017 18:42, "Rich"<EMAIL_ADDRESS>escribió:

Right @orschiro https://github.com/orschiro, how about this. $1 (USD) /
month for a maximum sync size of 1GB. Subscription will be via Patreon
https://www.patreon.com/ (I'll create an xBrowserSync Patreon account)
to save me having to manage accounts/payments. There will be some caveats
however:

The subscription will be per sync ID (easier to manage max sync size
for a given ID)
This will obviously affect anonymity aspects of the service, though
I will still endeavour not to store any personal information within the
xBrowserSync system. Your personal/payment data will be stored on Patreon
along with the sync ID you are using, and xbs will check subscription data
via Patreon's APIs (I still need to confirm exactly how this will work but
I think it's possible in theory).

Providing this functionality will take a bit of time for me to build but
I'll aim to release it along with the Firefox support in the upcoming
release.
What do you think?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/xBrowserSync/App/issues/3#issuecomment-335534827, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAKbw0jKUXZPInKE3LbHO2Q-kNpsP8Mjks5sq55fgaJpZM4MXQfC
.

Ok great! If you'd like to post this on Reddit please go ahead. Xbs only has a small user base but it's growing steadily.
-------- Original Message --------
On 10 Oct 2017, 19:22, Robert Orzanna wrote:

Sounds good to me! Shall we share the link to this issue thread to Reddit
and the like to get a feeling for how many people would support such a
Patreon campaign?
El 10/10/2017 18:42, "Rich"<EMAIL_ADDRESS>escribió:

Right @orschiro https://github.com/orschiro, how about this. $1 (USD) /
month for a maximum sync size of 1GB. Subscription will be via Patreon
https://www.patreon.com/ (I'll create an xBrowserSync Patreon account)
to save me having to manage accounts/payments. There will be some caveats
however:

The subscription will be per sync ID (easier to manage max sync size
for a given ID)
This will obviously affect anonymity aspects of the service, though
I will still endeavour not to store any personal information within the
xBrowserSync system. Your personal/payment data will be stored on Patreon
along with the sync ID you are using, and xbs will check subscription data
via Patreon's APIs (I still need to confirm exactly how this will work but
I think it's possible in theory).

Providing this functionality will take a bit of time for me to build but
I'll aim to release it along with the Firefox support in the upcoming
release.
What do you think?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/xBrowserSync/App/issues/3#issuecomment-335534827, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAKbw0jKUXZPInKE3LbHO2Q-kNpsP8Mjks5sq55fgaJpZM4MXQfC
.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

@nero120 can you respond to this?
https://www.reddit.com/r/opensource/comments/75nhbn/who_wants_to_support_an_open_source_web_browser/do81jef/

Hey Rich.
That sounds good to me. Maybe the target group for this is actually fine
setting up their own server.
Right now I'm not interested doing so but may consider that for the future!

Ok no problem @orschiro, sorry I couldn't be of more help at this time. I'll close this issue now.

Absolutely no problem. You helped a lot already ☺

I too would really like this feature.  I am successfully running my own XBrowserSync server, so the storage space is not an issue for me.
In my case, I essentially have 3 sets of bookmarks that I am trying to sync - my "work" bookmarks, my "personal" bookmarks, and my "shared" bookmarks. I have 2 devices which need all 3 sets on them, 2 devices that need the "work" and "shared" bookmarks, and 3 devices that need "personal" and "shared".
I used to be able to do this perfectly with XMarks, which as you know recently shut down.  Since then, I have switched to XBrowserSync, but have to use different profiles for each group of systems and manually copy links between the different bookmark sets (meaning I have to copy the links manually 2 or 3 times instead of 4 to 7).

Hi @Shadowpheonix, since this thread is tracking an old issue more related to the data limit, could I ask you to open a new issue for tracking your request and detail exactly what functionality you would like added? That way I can properly assess what's needed and gauge popularity better when picking up new features to implement. Thanks! 😄


Add magic option to pylint to try to fix numpy errors.

Option --extension-pkg-whitelist=numpy
See
https://bitbucket.org/logilab/pylint/issues/397/pylint-and-numpy-produce-e1101-messages

Current coverage is 100.00%

Merging #106 into master will not affect coverage as of 0b9fb49

@@            master    #106   diff @@
======================================
  Files           29      29
  Stmts          956     956
  Branches         0       0
  Methods
======================================
  Hit            956     956
  Partial          0       0
  Missed           0       0

Review entire Coverage Diff as of 0b9fb49

Powered by Codecov. Updated on successful CI builds.


Move species from plant to starter (seeds)

That way we don’t need a different plant for each new species of a plant.

Added to seed packet table, will eventually remove from plant table

Removed from plant table as well


DerivedDeclarator inconsistency

Enum DerivedDeclarator combines pointer, array, and function declarators. However, pointer declarators in C behave differently from array and function declarators. Pointer declarators are considered in right-to-left order, but array declarators go from left to right. For example:
int * const * volatile a[2][4];

This declares a as (array 2 of (array 4 of (volatile pointer to (const pointer to (int))))), but the DerivedDeclarators will be provided in the following order: Pointer(const), Pointer(volatile), Array(2), Array(4).
When using this list of DerivedDeclarators to build C types, special care should be taken to apply pointers in one direction and when they end, apply the rest in reverse direction. It would be more convenient to have RTL declarators and LTR declarators separated in the AST type system.
This is only my wish and suggestion and not a bug report. Please feel free to reject this issue as "won't do" if it goes against the philosophy of your crate.

Yes, I think it makes sense. Perhaps something like #45?


ImportError: No module named 'pysqlite2'

Dear Airflow Maintainers,
After install from pypi using pip：
pip install airflow
I am trying to initialize the database：
airflow initdb
but I get this error：
Traceback (most recent call last):
File "/usr/local/bin/airflow", line 4, in
from airflow import configuration
File "/usr/local/lib/python2.7/site-packages/airflow/init.py", line 16, in
from airflow.models import DAG
File "/usr/local/lib/python2.7/site-packages/airflow/models.py", line 40, in
from airflow import settings, utils
File "/usr/local/lib/python2.7/site-packages/airflow/settings.py", line 62, in
engine = create_engine(SQL_ALCHEMY_CONN, **engine_args)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/init.py", line 386, in create_engine
return strategy.create(*args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 75, in create
dbapi = dialect_cls.dbapi(**dbapi_args)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/dialects/sqlite/pysqlite.py", line 339, in dbapi
raise e
ImportError: No module named pysqlite2
and my python version is 2.7.10
Operating System:Linux hadoop123 2.6.32-431.29.2.el6.x86_64 #1 SMP Tue Sep 9 21:36:05 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
Python packages：
Babel==1.3
Flask==0.10.1
Flask-Admin==1.4.0
Flask-Cache==0.13.1
Flask-Login==0.2.11
Flask-WTF==0.12
Jinja2==2.8
Mako==1.0.4
Markdown==2.6.6
MarkupSafe==0.23
Pygments==2.1.3
SQLAlchemy==1.0.12
WTForms==2.1
Werkzeug==0.11.5
airflow==1.7.0
alembic==0.8.5
chartkick==0.4.2
croniter==0.3.12
dill==0.2.5
future==0.15.2
gunicorn==19.3.0
itsdangerous==0.24
numpy==1.11.0
pandas==0.18.0
python-dateutil==2.5.2
python-editor==1.0
pytz==2016.3
requests==2.9.1
setproctitle==1.1.9
six==1.10.0
thrift==0.9.3
wsgiref==0.1.2

Please copy paste your airflow.cfg

Psqlite2 has been long time renamed to sqlite3 when it became part of Python. You seem to have some very old versions lying around?

following is my airflow.cfg:
[core]
The home folder for airflow, default is ~/airflow
airflow_home = /root/airflow
The folder where your airflow pipelines live, most likely a
subfolder in a code repository
dags_folder = /root/airflow/dags
The folder where airflow should store its log files. This location
base_log_folder = /root/airflow/logs
An S3 location can be provided for log backups
For S3, use the full URL to the base folder (starting with "s3://...")
s3_log_folder = None
The executor class that airflow should use. Choices include
SequentialExecutor, LocalExecutor, CeleryExecutor
executor = SequentialExecutor
The SqlAlchemy connection string to the metadata database.
SqlAlchemy supports many different database engine, more information
their website
sql_alchemy_conn = sqlite:////root/airflow/airflow.db
The SqlAlchemy pool size is the maximum number of database connections
in the pool.
sql_alchemy_pool_size = 5
The SqlAlchemy pool recycle is the number of seconds a connection
can be idle in the pool before it is invalidated. This config does
not apply to sqlite.
sql_alchemy_pool_recycle = 3600
The amount of parallelism as a setting to the executor. This defines
the max number of task instances that should run simultaneously
on this airflow installation
parallelism = 32
The number of task instances allowed to run concurrently by the scheduler
dag_concurrency = 16
Are DAGs paused by default at creation
dags_are_paused_at_creation = False
The maximum number of active DAG runs per DAG
max_active_runs_per_dag = 16
Whether to load the examples that ship with Airflow. It's good to
get started, but you probably want to set this to False in a production
environment
load_examples = True
Where your Airflow plugins are stored
plugins_folder = /root/airflow/plugins
Secret key to save connection passwords in the db
fernet_key = cryptography_not_found_storing_passwords_in_plain_text
Whether to disable pickling dags
donot_pickle = False
How long before timing out a python file import while filling the DagBag
dagbag_import_timeout = 30
[webserver]
The base url of your website as airflow cannot guess what domain or
cname you are using. This is use in automated emails that
airflow sends to point links to the right web server
base_url = http://localhost:8080
The ip specified when starting the web server
web_server_host = <IP_ADDRESS>
The port on which to run the web server
web_server_port = 8080
Secret key used to run your flask app
secret_key = temporary_key
Number of workers to run the Gunicorn web server
workers = 4
The worker class gunicorn should use. Choices include
sync (default), eventlet, gevent
worker_class = sync
Expose the configuration file in the web server
expose_config = true
Set to true to turn on authentication : http://pythonhosted.org/airflow/installation.html#web-authentication
authenticate = False
Filter the list of dags by owner name (requires authentication to be enabled)
filter_by_owner = False
[email]
email_backend = airflow.utils.send_email_smtp
[smtp]
If you want airflow to send emails on retries, failure, and you want to
the airflow.utils.send_email function, you have to configure an smtp
server here
smtp_host = localhost
smtp_starttls = True
smtp_ssl = False
smtp_user = airflow
smtp_port = 25
smtp_password = airflow
smtp_mail_from =<EMAIL_ADDRESS>[celery]
This section only applies if you are using the CeleryExecutor in
[core] section above
The app name that will be used by celery
celery_app_name = airflow.executors.celery_executor
The concurrency that will be used when starting workers with the
"airflow worker" command. This defines the number of task instances that
a worker will take, so size up your workers based on the resources on
your worker box and the nature of your tasks
celeryd_concurrency = 16
When you start an airflow worker, airflow starts a tiny web server
subprocess to serve the workers local log files to the airflow main
web server, who then builds pages and sends them to users. This defines
the port on which the logs are served. It needs to be unused, and open
visible from the main web server to connect into the workers.
worker_log_server_port = 8793
The Celery broker URL. Celery supports RabbitMQ, Redis and experimentally
a sqlalchemy database. Refer to the Celery documentation for more
information.
broker_url = sqla+mysql://airflow:airflow@localhost:3306/airflow
Another key Celery setting
celery_result_backend = db+mysql://airflow:airflow@localhost:3306/airflow
Celery Flower is a sweet UI for Celery. Airflow has a shortcut to start
it airflow flower. This defines the port that Celery Flower runs on
flower_port = 5555
Default queue that tasks get assigned to and that worker listen on.
default_queue = default
[scheduler]
Task instances listen for external kill signal (when you clear tasks
from the CLI or the UI), this defines the frequency at which they should
listen (in seconds).
job_heartbeat_sec = 5
The scheduler constantly tries to trigger new tasks (look at the
scheduler section in the docs for more information). This defines
how often the scheduler should run (in seconds).
scheduler_heartbeat_sec = 5
Statsd (https://github.com/etsy/statsd) integration settings
statsd_on =  False
statsd_host =  localhost
statsd_port =  8125
statsd_prefix = airflow
[mesos]
Mesos master address which MesosExecutor will connect to.
master = localhost:5050
The framework name which Airflow scheduler will register itself as on mesos
framework_name = Airflow
Number of cpu cores required for running one task instance using
'airflow run <dag_id> <task_id> <execution_date> --local -p <pickle_id>'
command on a mesos slave
task_cpu = 1
Memory in MB required for running one task instance using
'airflow run <dag_id> <task_id> <execution_date> --local -p <pickle_id>'
command on a mesos slave
task_memory = 256
Enable framework checkpointing for mesos
See http://mesos.apache.org/documentation/latest/slave-recovery/
checkpoint = False
Failover timeout in milliseconds.
When checkpointing is enabled and this option is set, Mesos waits until the configured timeout for
the MesosExecutor framework to re-register after a failover. Mesos shuts down running tasks if the
MesosExecutor framework fails to re-register within this timeframe.
failover_timeout = 604800
Enable framework authentication for mesos
See http://mesos.apache.org/documentation/latest/configuration/
authenticate = False
Mesos credentials, if authentication is enabled
default_principal = admin
default_secret = admin

My system is centos6.5 and the python originally come with is 2.6.6. And I noticed the airflow is tested under python2.7.* ,so I install the python2.7.10

thought you should find "_sqlite3.so" right? @xu-xiaoqiang


help: how to custom path multiple sitemap?

📚 What are you trying to do?
 sitemap: {     sitemaps: {       blogs: {         sources: ["/api/__sitemap__/blogs"],       },       pages: {         sources: ["/api/__sitemap__/pages"],       },       articles: {         sources: ["/api/__sitemap__/articles"],       },       galleries: {         sources: ["/api/__sitemap__/galleries"],       },     },   },
I want custom paths.
For example:

from /blogs-sitemap.xml to /sitemap/blogs.xml
from /pages-sitemap.xml to /sitemap/pages.xml
from /articles-sitemap.xml to /sitemap/articles.xml
from /galleries-sitemap.xml to /sitemap/galleries.xml

🔍 What have you tried?
No response
ℹ Additional context
No response

I'm not exactly sure what you're asking for but if you use Nuxt Sitemap v6 beta it uses the paths on the right.

I'm not exactly sure what you're asking for but if you use Nuxt Sitemap v6 beta it uses the paths on the right.

thanks, my problem is solved in v6


Support 1.20.5-1.20.6

Hello creator of this mod!
I noticed that your mod does not support 1.20.5-1.20.6 so please add support for this version!

Otherwise I don't know why your mod supports this version, but it gets a crash...

Link for those who want to play now on the new version with this mod: https://github.com/ShrikerChestTrees/Resolution-Control-New-Versions/releases/tag/Release


Amy Event URL Validation

I believe we recently updated the validation rules for the workshop website (URL) in AMY to accept any website format. However, when trying to 'Update from URL' I am getting this error message (see thread).
Here is the AMY event: https://amy.carpentries.org/workshops/event/2019-11-26-Potsdam-Berlin/
new github page:
http://swc-bb.gitext.gfz-potsdam.de/pages/2019-11-26-Potsdam-Berlin/
New Repo: https://gitext.gfz-potsdam.de/swc-bb
old github page:
https://swc-bb.github.io/2019-11-26-Potsdam-Berlin-R/ (edited)
Here is our slack conversation:
Maneesha: AMY will accept any URL in the event's record.  However to use "Update from URL" AMY needs to know the url of the github repo it is from.  If the website url is in the typical format (username.github.io/YYYY-MM-DD-sitename) then AMY can figure out the github repo.  If the URL is in a different format, then AMY can't figure out the github repo and therefore can't update from URL.  Let me know if that's clear.
François:I thought (and a quick inspection of AMY's code suggests this) that the reading of the meta data about the workshops was done by looking at the meta tags in the HTML version of the website and should therefore be independent of the whether the repository is hosted on GitHub or somewhere else.  This validation might be unnecessary.
Maneesha: Thanks for that @francois  We should then be able to make this work if they are still using our template, even if the URL isn't in the standard format.  If they are not using our template then it may not have the meta tags and therefore can't update from URL (example https://www.sib.swiss/training/course/2019-07-elixir-sib-dc)
François: yes, I agree. The checks about whether the metadata exist or not shouldn't depend on the scheme of the URL (because people could create a workshop website that doesn't use our template using GitHub). Could you please open an issue about this so we can address it in the future?

Hello @Talishask. This is a peculiar behavior. The workshop in Potsdam/Berlin in its HTML website has no slug defined (see line 21 in http://swc-bb.gitext.gfz-potsdam.de/pages/2019-11-26-Potsdam-Berlin/). Because of that, we don't find this <meta> entry for slug. We rely on slug being available, because we check that tags are available with this slug.
I think there are two issues here.

The workshop website doesn't define slug. We relied on it, so it perhaps should not be empty? This may be error in workshop-template.
AMY relies of slug having some data, but I think it wouldn't hurt us to accept empty slug <meta> tag on workshop website.

Anyway, I think I can sort-of easily fix this bug (?) on AMY side.

we'll have to think a little bit more about this I think. Depending on how critical it is to have the slug in the HTML metadata, we might have to require instructors to use GitHub. The workshop-template relies on the GitHub API (via the github-metadata jekyll plugin) to fill in the value of slug in the HTML. For this particular website, because they used GitLab, this information wasn't available.

I leave it up to you, but from my point of view, adjusting AMY to accept [any/majority/most] of the expected tags from workshop website source is easier than rethinking workshop-template's internal design. The minor downside is that with "update from workshop URL" you won't get slug updated when it's not there.

@pbanaszkiewicz  The slug is a required field, correct? So there should never be a case where the slug is not in AMY.

@maneesha yes, slug is mandatory. What I meant about "minor downside" is that you can use "update from workshop URL" to, for example, update workshop 2020-xxxx with workshop 2020-zzzz data by pointing to its website, but since slug <meta> tag won't be required, you won't change 2020-xxxx slug to 2020-zzzz.

Revisiting this for this workshop submission. https://amy.carpentries.org/requests/selforganised_submission/502/
The information from this workshop website won't autofill our AMY event. Is this cause by the same hosting conflict as noted above?

@Talishask: yes, in both cases they don't have slug filled out in the HTML source:
<!doctype html>
<html lang="en">
  <head>

    <meta name="slug" content="" />
    <meta name="startdate" content="2020-05-29" />
    <meta name="enddate" content="2020-06-01" />
    <meta name="humandate" content="May 29 (Portrait Room) / June 1 (Lecture Room D), 2020" />
    <meta name="country" content="us" />
    <meta name="venue" content="NIST" />

and
<!doctype html>
<html lang="en">
  <head>

    <meta name="slug" content="" />
    <meta name="startdate" content="2020-03-16" />
    <meta name="enddate" content="2020-03-17" />
    <meta name="humandate" content="Mar 16-17, 2020" />
    <meta name="country" content="us" />
    <meta name="venue" content="Tennessee Tech University" />