Import/export signal-desktop backup data

hi @xeals ,
I'm really happy you've started the work on this project, as I'm frustrated with the backup/restore functionality of Signal (desktop (hackable), Android (should be better since v4.20), and iOS (missing completely!)).
Would it be in scope of this project to: ?

build extended functionality of Signal's backup & restore?
support migration from android/iOS/desktop
offer signal backup data in a widely supported format (your current plaintext XML, CSV)
possibility to import from/to other clients (SMS, whatsapp, ...)

With regards to the Desktop backup and restore, I have figured a (manual) way which could well integrate in your CLI:
https://github.com/signalapp/Signal-Desktop/issues/522#issuecomment-389101774
Eg.:
signal-back backup <path to Signal's folder> <output file name.zip>
signal-back restore <input desktop backup.zip> <path to Signal>

I followed the instructions for converting the Signal Messenger backup file and it appears to have been successful.  The one part missing in the instructions was to rename the windows file with an ".exe" at the end so it runs as an executable.
I figured that out by instinct, I figure most people desperate enough to migrate out of Signal because of their recent problems with the newer versions (for me anything after 4.18.3) seems to have significant issues not importing the backups, or just crash repeatedly no matter if you use the GPS or sideload the APK.  Anyhow, I digress...
I see that the output XML file is significantly smaller than the signal backup.  Is that due to the bloated nature of the Signal storage method or is it just removing all media (e.g. music, photos, videos, etc.)?  Is it just pulling in only plain text?  Is there a way to get all the media imported as well?  I think this would be a fantastic feature but then again I do not know enough about how all this stuff works to really understand what it is and is not capable of.  Can you help a noob understand?  Thanks!


Implement vm.makeAddr

Component
Forge
Describe the feature you would like
Describe the feature you would like
🌟 Feature Request
📝 Description
Implementing the vm.makeAddr() cheat as well as vm.makeAddrAndKey() cheat
Declaration
function makeAddr(string memory name) internal returns(address addr);

function makeAddrAndKey(string memory name) internal returns(address addr, uint256 privateKey);

🤔 Rationale
This method is required to create an address derived from the provided name.
🖼 Mockups / Examples
vm.makeAddr()
address alice = makeAddr("alice");
emit log_address(alice); // 0x328809bc894f92807417d2dad6b7c998c1afdac6

vm.makeAddrAndKey()
(address alice, uint256 key) = makeAddrAndKey("alice");
emit log_address(alice); // 0x328809bc894f92807417d2dad6b7c998c1afdac6
emit log_uint(key); //<PHONE_NUMBER>1660933374592024341600875602376452319261984317470407481576058979585

🎯 Task Checklist

[ ] Implement vm.makeAddr() and vm.makeAddrAndKey()
[ ] Write tests for vm.makeAddr() and vm.makeAddrAndKey()
[ ] Add inline documentation for vm.makeAddr() and vm.makeAddrAndKey()

Additional context
No response

Thank you for the suggestion!! We will be including this in a future release.

Fixed in dev branch with new approach.


Hash routing breaks build

Hash routing as explained on the readme.md breaks the build:
Source code:

✖ ERROR TypeError [ERR_INVALID_ARG_TYPE]: The "chunk" argument must be of type string or an instance of Buffer or Uint8Array. Received undefined
    at new NodeError (node:internal/errors:371:5)
    at _write (node:internal/streams/writable:312:13)
    at WriteStream.Writable.write (node:internal/streams/writable:334:10)
    at handlePrerenderError (/Users/davidkolosowski/test/node_modules/preact-cli/lib/lib/webpack/prerender.js:110:18)

Create a new default app:
npx preact-cli create default my-project
Add history package:
npm install --save history
Add following to app.js:
import { h } from 'preact';
import { Router } from 'preact-router';

import Header from './header';

// Code-splitting is automated for `routes` directory
import Home from '../routes/home';
import Profile from '../routes/profile';
import { createHashHistory  } from 'history';

const App = () => (
	<div id="app">
		<Header />
		<Router history={createHashHistory()}>
			<Home path="/" />
			<Profile path="/profile/" user="me" />
			<Profile path="/profile/:user" />
		</Router>
	</div>
)

export default App;

Run build:
npm run build
Build crashes.

This is correct behavior. If you'll take a look at the full error (it looks like you cut off the first few lines), you'll see:
ReferenceError: document is not defined

Hash routers depend on the DOM, which is unavailable when prerendering as this happens in Node.
You can opt out of prerendering in preact-cli with the --no-prerender flag, see: preact-cli#pre-rendering

Excellent thanks for that answer @rschristian. Maybe just needs the README updated then to include this.


feat: decouple checkboxable and headerCheckboxable from SelectionType…

….checkbox
This change enables the datatable user to programatically set header checkbox and
column checkbox without the need of using the SelectionType.checkbox. This supports
use cases by combining multi row selection with an additional checkbox view.
What kind of change does this PR introduce? (check one with "x")

[ ] Bugfix
[x] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] CI related changes
[ ] Other... Please describe:

What is the current behavior? (You can also link to an open issue here)
Header checkbox is only visible with selection type checkbox.
What is the new behavior?
Can combine multi row selection with check box visualisation and header selection.
All controllable by the datatable user.
Does this PR introduce a breaking change? (check one with "x")

[ ] Yes
[x] No

If this PR contains a breaking change, please describe the impact and migration path for existing applications: ...
Other information:

@dr-itz https://github.com/siemens/ngx-datatable/pull/19#issue-1074434076 needs to be merged first. Than I can rebase this.

@dr-itz many thanks. This is rebased and on the go.


[BUG] Do not activate the LVM device on the harvester node

Describe the bug
Some Linux distributions like Ubuntu will create a root filesystem with LVM.
Once these PVCs are attached to the harvester node, we have a chance to activate them.
Then, if we activate the LVM device, we will see the DM IO Error when the related VM migration.
Related issue: https://github.com/harvester/harvester/issues/3843
To Reproduce
Please refer to this comment
https://github.com/harvester/harvester/issues/3843#issuecomment-1535689155
Expected behavior
Do not see the LVM device and any IO Error when VM migrate
Support bundle
None
Environment

Harvester ISO version: v1.2.0 rc version
Underlying Infrastructure (e.g. Baremetal with Dell PowerEdge R630): KVM-based harvester node

Additional context
We also have some solutions to the above issue.
The main concept is avoid to activating the LVM device on the host.

The #4674 is a good enhancement, should be also mentioned in #3261

Provide test result on v1.3.0-rc1, close as fixed.
Environment

Harvester

Version: v1.3.0-rc1
Profile: QEMU/KVM, 2 nodes (8C/16G/500G)
ui-source: Auto

Steps

Create VM with LVM

 Currently VM is on harvester-node-1

Migrate VM to node-0 and

 VM's LVM Will NOT mount by node-0 :heavy_check_mark:

 No I/O error on dev dm- in kernel log :heavy_check_mark:

Migrate VM back to node-1 and

 VM's LVM Will NOT mount by node-1 :heavy_check_mark:

 No I/O error on dev dm- in kernel log :heavy_check_mark:

Note
Can reproduce in v1.2.1

 Create a VM with LVM

 Migrate to node-0 and it mounts VM's LVM

 Migrate back to node-1 and it mounts VM's LVM

 Has I/O error on dev dm-


Cancel streamed downloads & fix progress for downloads

New Pull Request Checklist

[x] I have read the Documentation
[x] I have searched for a similar pull request in the project and found none
[x] I have updated this branch with the latest main branch to avoid conflicts (via merge from master or rebase)
[x] I have added the required tests to prove the fix/feature I'm adding
[x] I have updated the documentation (if necessary)
[x] I have run the tests without failures
[x] I have updated the CHANGELOG.md in the corresponding package

Additional context and info (if any)

Before review: Could we abstract the implementation of this cancellation above the specific adapter? If we're doing this in adapters, then every adapter needs to consider the same functionality.

I will see what I can do, but I already know that this is basically not supported on web.

This is a lot more complex. We have completely different behavior for different adapters when doing streamed responses/downloads and most of it can not be abstracted away.
For IOHttpClientAdapter we have a ResponseBody with a stream so the await dio.get succeeds after the connection is established with a Response and the cancellation exception is thrown on the stream.
For BrowserHttpClientAdapter we have a ResponseBody with bytes and the adapter has to wait until everything is received, before completing with a response. So the cancellation exception is thrown on the await dio.get.
And there is no way to access other information from the XHR when aborting.

What about the HTTP/2 adapter?

Fixed it there as well. I think we should merge this and brain storm if we can abstract this away separately.

Is this still on your track? The last time I review this it only remains a few nits.

@kuhnroyal Is this still on your track? The last time I review this it only remains a few nits.

@kuhnroyal Is this still on your track? The last time I review this it only remains a few nits.

Yea

Superseeded by https://github.com/cfug/dio/pull/2068 due to lots of updates on main


soopervisor add should print the soopervisor export command to run next

Also print the --mode force option

I think printing all the options is too much. the most common  one is --mode force


performing full reimport crashes Unreal 100% of the time.

The initial import of the articy file worked, but after the project grew to a size on disk of more than 14gb, performing a full-reimport causes the following crash:
`LoginId:xxxxxxxxxxxx
EpicAccountId:xxxxxxxxxxxxx
Unhandled Exception: EXCEPTION_ACCESS_VIOLATION reading address 0xffffffff
UE4Editor_CoreUObject!FPropertyProxyArchive::operator<<() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\CoreUObject\Public\UObject\PropertyProxyArchive.h:45]
UE4Editor_CoreUObject!UStruct::SerializeExpr() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\CoreUObject\Public\UObject\ScriptSerialization.h:222]
UE4Editor_CoreUObject!UStruct::SerializeExpr() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\CoreUObject\Private\UObject\Class.cpp:2126]
UE4Editor_CoreUObject!UStruct::SerializeExpr() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\CoreUObject\Private\UObject\Class.cpp:2126]
UE4Editor_CoreUObject!UStruct::Serialize() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\CoreUObject\Private\UObject\Class.cpp:1925]
UE4Editor_CoreUObject!UFunction::Serialize() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\CoreUObject\Private\UObject\Class.cpp:5555]
UE4Editor_CoreUObject!FFindReferencersArchive::ResetPotentialReferencer() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\CoreUObject\Private\Serialization\FindReferencersArchive.cpp:89]
UE4Editor_UnrealEd!ObjectTools::ForceReplaceReferences() [D:\Build++UE4+Licensee\Sync\Engine\Source\Editor\UnrealEd\Private\ObjectTools.cpp:798]
UE4Editor_UnrealEd!ObjectTools::ForceReplaceReferences() [D:\Build++UE4+Licensee\Sync\Engine\Source\Editor\UnrealEd\Private\ObjectTools.cpp:922]
UE4Editor_UnrealEd!ObjectTools::ForceDeleteObjects() [D:\Build++UE4+Licensee\Sync\Engine\Source\Editor\UnrealEd\Private\ObjectTools.cpp:2811]
UE4Editor_ArticyEditor!CodeGenerator::DeleteGeneratedAssets() [D:\Build++Portal+Promotion\Sync\LocalBuilds\PluginTemp\HostProject\Plugins\ArticyImporter\Source\ArticyEditor\Private\CodeGeneration\CodeGenerator.cpp:178]
UE4Editor_ArticyEditor!CodeGenerator::GenerateAssets() [D:\Build++Portal+Promotion\Sync\LocalBuilds\PluginTemp\HostProject\Plugins\ArticyImporter\Source\ArticyEditor\Private\CodeGeneration\CodeGenerator.cpp:269]
UE4Editor_ArticyEditor!TBaseFunctorDelegateInstance<void __cdecl(UArticyImportData *),<lambda_5fbe6f406c99ec1ba37b2e39b904832d> >::ExecuteIfSafe() [D:\RocketSync\4.25.0-13144385+++UE4+Release-4.25\Working\Engine\Source\Runtime\Core\Public\Delegates\DelegateInstancesImpl.h:1005]
UE4Editor_ArticyEditor!TBaseMulticastDelegate<void,UArticyImportData *>::Broadcast() [D:\RocketSync\4.25.0-13144385+++UE4+Release-4.25\Working\Engine\Source\Runtime\Core\Public\Delegates\DelegateSignatureImpl.inl:1013]
UE4Editor_ArticyEditor!CodeGenerator::OnCompiled() [D:\Build++Portal+Promotion\Sync\LocalBuilds\PluginTemp\HostProject\Plugins\ArticyImporter\Source\ArticyEditor\Private\CodeGeneration\CodeGenerator.cpp:312]
UE4Editor_ArticyEditor!TBaseFunctorDelegateInstance<void __cdecl(bool),<lambda_0b32b99d7466b29ddec2cdf21af7a4ca> >::ExecuteIfSafe() [D:\RocketSync\4.25.0-13144385+++UE4+Release-4.25\Working\Engine\Source\Runtime\Core\Public\Delegates\DelegateInstancesImpl.h:1007]
UE4Editor_HotReload!TBaseMulticastDelegate<void,bool>::Broadcast() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\Core\Public\Delegates\DelegateSignatureImpl.inl:1013]
UE4Editor_HotReload!FHotReloadModule::DoHotReloadInternal() [D:\Build++UE4+Licensee\Sync\Engine\Source\Developer\HotReload\Private\HotReload.cpp:890]
UE4Editor_HotReload!UE4Function_Private::TFunctionRefCaller<<lambda_d85446a946c3f6776c68ebfeb93e5785>,void __cdecl(TMap<FName,FString,FDefaultSetAllocator,TDefaultMapHashableKeyFuncs<FName,FString,0> > const &,bool,enum ECompilationResult::Type)>::Call() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\Core\Public\Templates\Function.h:549]
UE4Editor_HotReload!FHotReloadModule::CheckForFinishedModuleDLLCompile() [D:\Build++UE4+Licensee\Sync\Engine\Source\Developer\HotReload\Private\HotReload.cpp:1865]
UE4Editor_HotReload!FHotReloadModule::Tick() [D:\Build++UE4+Licensee\Sync\Engine\Source\Developer\HotReload\Private\HotReload.cpp:1427]
UE4Editor_Core!FTicker::Tick() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\Core\Private\Containers\Ticker.cpp:95]
UE4Editor!FEngineLoop::Tick() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\Launch\Private\LaunchEngineLoop.cpp:5051]
UE4Editor!GuardedMain() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\Launch\Private\Launch.cpp:169]
UE4Editor!GuardedMainWrapper() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\Launch\Private\Windows\LaunchWindows.cpp:137]
UE4Editor!WinMain() [D:\Build++UE4+Licensee\Sync\Engine\Source\Runtime\Launch\Private\Windows\LaunchWindows.cpp:268]
UE4Editor!__scrt_common_main_seh() [d:\agent_work\5\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl:288]
kernel32
ntdll`

Interesting. This appears to be an issue on the side of Unreal Engine, not the plugin code, as this crash happens during deletion of the previously generated assets.
How large are the generated articy assets (import data asset + global variables + database + packages)?
Are you referencing the generated assets anywhere directly?

For now, you should be able to bypass the crash by deleting the generated assets on disk. As there should be no references to the assets in the first place, doing so should be safe and the generating code won't trigger the code that is responsible for the crash.

your suggestions have aided me in discovering a work around, but it is a very long and temperamental process and not sustainable long term. Here are the steps I had to take in order for the import to work in our main project:

close p4v (perforce)
in windows explorer, right click on project folder and select properties
untick "read only" and apply (takes a long time)
navigate into the project folder and delete the .vs, DerivedDataCache, Intermediate, & Saved folders
delete the [project].sln file
navigate into the Content folder
delete the articyue4 and the articy .uasset files
delete the ArticyContent folder
navigate back to main project root
right click on project and select "generate visual studio project files"
open the .sln and build
open the project
open any maps that rely on the articy integration and remove the references (for us, it is a Loc_cell.umap, the generated clickable zones, level handler blueprint, and location blueprint in that level)
export from articy
click yes at import (this will perform the import, but crash the program)
open the project solution and build
open the project
from the Articy plugin menu, select full reimport
open the level that references the integration and reconnect the hooks (for us this is open Loc_cell and re-add level handler and location blueprints, then click generate location and save)
test dialogue trees (success)

As you can see, this is a bit cumbersome. Would it be possible to schedule a call with you to debug this behavior and devise a solutions strategy?

Yes, please send a ticket to<EMAIL_ADDRESS>I will send you my discord name and we can discuss things further.
I am confident that if a fix is not in sight, we should be able to find a workaround that is much more acceptable than the one you have outlined.

Try removing only Content*.articyue4 and corresponding Content*.uasset
It may be useful to also remove Content\ArticyContent\Generated*Database.uasset and Content\ArticyContent\Generated*GlobalVariables.uasset. It seems that it crashes when Unreal tries to deserialize those assets. We workarounded this issue by creating Jenkins job to automate removing and importing articy assets. If you don't have any CI system you could try creating some .bat file to automate it.

Try removing only Content*.articyue4 and corresponding Content*.uasset
It may be useful to also remove Content\ArticyContent\GeneratedDatabase.uasset and Content\ArticyContent\GeneratedGlobalVariables.uasset. It seems that it crashes when Unreal tries to deserialize those assets. We workarounded this issue by creating Jenkins job to automate removing and importing articy assets. If you don't have any CI system you could try creating some .bat file to automate it.

Have you or your team encountered the same issue? I had a debug session with wvaughn409 today and it seems like a specific animation blueprint is being considered for reference cleanup during articy asset deletion (with no actual referencing going on), and some issue in that animation blueprint causes the crash.

Closing as this seems to have been a very particular oddity in the reporter's project that was resolved when they recreated the offending animation asset. If anyone else is experiencing something something similar, please let us know so we can try to track it down.


Bundling issues with imported workers from wrapper

When bundling the wrapper in a non-esm project, the following lines throw an error:
https://github.com/TypeFox/monaco-components/blob/90576851d8184272566581d24aeef082e26330a1/packages/monaco-editor-wrapper/src/index.ts#L14-L21
Since these workers aren't necessarily a feature of the wrapper, would it make sense to move them to a separate export that can be imported if a downstream user wants to do that? For most users, importing these workers by default does not pose any advantage.

The best way forward is to move those imports to another file which imports/exports everything from the index.js (MonacoEditorLanguageClientWrapper, CodeEditorConfig, etc.). This becomes then another export in the packages.json. Also, two different bundles will be supplied (raw and raw+languages) and exported in the packages.json.
Open question/requires testing is how to use/expose these extra wrapper exports in monaco-editor-comp.

This has been implemented. The new default is that no additional language support is contained. You can use another export to obtain them. The same applies to the bundles:
- monaco-editor-comp/allLanguages
- monaco-editor-comp/bundle
- monaco-editor-comp/bundle/allLanguages


Support for other unstructured data like pdf, word etc.,

It would be good if we can provide PDF or other unstructured data from which we can generate synthetic data.

Thank you for filing this issue, @gnthaker! Helps us keep track of it. We discussed in last night's triage meeting that we desire to also create better tooling for PDF --> Markdown conversion and generally make data ingestion a less cumberson process. As we are moving fast and a young project, I am not sure where on our roadmap this will land timing-wise.
Once again, thank you for filing this issue and assuring we don't lose track of this clear need.

The people in the community who I know who have talked the most about this need are on the Triage team. If you want to talk to them about scoping this work, you can find them in #triage on InstructLab Slack.

Yep, @gnthaker, please reach out; we have some thoughts and suggestions to get something off the ground, but nothing formalized in a pipeline or anything.


Disable ratelimiter if running on Deta

Ratelimiters do not work on Deta Micros, and are unnecessary anyway.
See my message in the Deta discord server.

on deta the rate limiting IP logic works for per seconds check the serverless functions don't sleep instantly.


Why does this only support prefix match?

This plugin uses binary search instead of scanning the whole tag file.

Is this plugin the only way, if I use vim-gutentags instead of gen_tags.vim/ncm2-gtags?


fix: Move DB agnostic sections out of sqlite database guide

With this change, Common Operators and Common Functions have been moved from the sqlite guide to the generic database guide.
I have also checked all the operator mappings and found some plain wrong information. For example != <val> is translated to != <val> with @cap-js/hana.
Original Issue
> q = SELECT`from ${Books} { ID, title} where ID != null`
> q.toSQL()
{
  sql: `… WHERE Books.ID is not NULL)`,
  values: []
}

but for non-null comparisons, != is translated to <>:
> q = SELECT`from ${Books} { ID, title} where ID != 207`
> q.toSQL()
{
  sql: `… WHERE Books.ID <> ?)`,
  values: [ 207 ]
}

While discovering this, I noticed that we do not have such an "operator mapping" section for our other databases. I think we need to review all database guides and try to find common concepts like the operator mapping or type mappings and document them in a homogenous way for all our databases.

ping @johannes-vogel @stewsk

does that also apply to java?

does that also apply to java?

@johannes-vogel Do you mean we'd need the equivalent docs for Java when moving those docs in the common guide?
@patricebender Is there anything I can support you with?

does that also apply to java?

@johannes-vogel Do you mean we'd need the equivalent docs for Java when moving those docs in the common guide?
@patricebender Is there anything I can support you with?

I think the "common operators" section must be moved to the generic part of the db guide, I would like to hear the POs opinions here. From my side, this change is fine (I only need to apply the suggestion from Bob).

does that also apply to java?

@johannes-vogel Do you mean we'd need the equivalent docs for Java when moving those docs in the common guide?
@patricebender Is there anything I can support you with?

I think the "common operators" section must be moved to the generic part of the db guide, I would like to hear the POs opinions here. From my side, this change is fine (I only need to apply the suggestion from Bob).

I was simply wondering whether this is node specific or also applicable for java. at the moment it's tagged as node specific. in general, fine for me:)

@MattSchur @agoerler Could you please check this PR? It's about moving a topic and also what is probably Node/Java specific (or not!)

@stewsk @johannes-vogel could you kindly review

@agoerler what do you think about adding the functions which are supported by the java runtime ({.impl .java}) in a similar fashion?

For CAP Java, the set of supported functions is documented here:

scalar functions: https://cap.cloud.sap/docs/java/working-with-cql/query-api#scalar-functions
predicated: https://cap.cloud.sap/docs/java/working-with-cql/query-api#predicate-functions

As mentioned earlier, these functions can be used on the DBs but also in remote OData consumption. We could add a link in an ({.impl .java}) variant.

@renejeglinsky how can I fix the broken anchor links mentioned in the build:
in: /releases/jun24
Unresolved hash link: /guides/databases-sqlite #standard-operators
Unresolved hash link: /guides/databases-sqlite #standard-functions
Unresolved hash link: /guides/databases-sqlite #sap-hana-functions

I can't find them in the repository :(


corrupted size vs. prev_size while consolidating

Errors met while running test_filamat ...
➜  bin ./test_filamat
[==========] Running 65 tests from 5 test suites.
[----------] Global test environment set-up.
[----------] 2 tests from StaticCodeAnalysisHelper
[ RUN      ] StaticCodeAnalysisHelper.getFunctionName
[       OK ] StaticCodeAnalysisHelper.getFunctionName (0 ms)
[ RUN      ] StaticCodeAnalysisHelper.getFunctionNameNoParenthesis
[       OK ] StaticCodeAnalysisHelper.getFunctionNameNoParenthesis (0 ms)
[----------] 2 tests from StaticCodeAnalysisHelper (0 ms total)

[----------] 36 tests from MaterialCompiler
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerNothingDetected
[       OK ] MaterialCompiler.StaticCodeAnalyzerNothingDetected (96 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerNothingDetectedVertex
[       OK ] MaterialCompiler.StaticCodeAnalyzerNothingDetectedVertex (88 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerNotFollowingINParameters
[       OK ] MaterialCompiler.StaticCodeAnalyzerNotFollowingINParameters (93 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerDirectAssign
[       OK ] MaterialCompiler.StaticCodeAnalyzerDirectAssign (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerDirectAssignVertex
[       OK ] MaterialCompiler.StaticCodeAnalyzerDirectAssignVertex (87 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerDirectAssignWithSwizzling
[       OK ] MaterialCompiler.StaticCodeAnalyzerDirectAssignWithSwizzling (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerSymbolAsOutParameterWithAliasing
[       OK ] MaterialCompiler.StaticCodeAnalyzerSymbolAsOutParameterWithAliasing (93 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerSymbolAsOutParameterWithAliasingAndSwizzling
[       OK ] MaterialCompiler.StaticCodeAnalyzerSymbolAsOutParameterWithAliasingAndSwizzling (93 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerSymbolInOutInChainWithDirectIndexIntoStruct
[       OK ] MaterialCompiler.StaticCodeAnalyzerSymbolInOutInChainWithDirectIndexIntoStruct (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerSymbolInOutInChain
[       OK ] MaterialCompiler.StaticCodeAnalyzerSymbolInOutInChain (93 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerBaseColor
[       OK ] MaterialCompiler.StaticCodeAnalyzerBaseColor (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerRoughness
[       OK ] MaterialCompiler.StaticCodeAnalyzerRoughness (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerMetallic
[       OK ] MaterialCompiler.StaticCodeAnalyzerMetallic (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerReflectance
[       OK ] MaterialCompiler.StaticCodeAnalyzerReflectance (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerAmbientOcclusion
[       OK ] MaterialCompiler.StaticCodeAnalyzerAmbientOcclusion (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerClearCoat
[       OK ] MaterialCompiler.StaticCodeAnalyzerClearCoat (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerTransmission
[       OK ] MaterialCompiler.StaticCodeAnalyzerTransmission (94 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerClearCoatRoughness
[       OK ] MaterialCompiler.StaticCodeAnalyzerClearCoatRoughness (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerClearCoatNormal
[       OK ] MaterialCompiler.StaticCodeAnalyzerClearCoatNormal (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerThickness
[       OK ] MaterialCompiler.StaticCodeAnalyzerThickness (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerSubsurfacePower
[       OK ] MaterialCompiler.StaticCodeAnalyzerSubsurfacePower (93 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerSubsurfaceColor
[       OK ] MaterialCompiler.StaticCodeAnalyzerSubsurfaceColor (91 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerAnisotropicDirection
[       OK ] MaterialCompiler.StaticCodeAnalyzerAnisotropicDirection (95 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerAnisotropic
[       OK ] MaterialCompiler.StaticCodeAnalyzerAnisotropic (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerSheenColor
[       OK ] MaterialCompiler.StaticCodeAnalyzerSheenColor (90 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerSheenRoughness
[       OK ] MaterialCompiler.StaticCodeAnalyzerSheenRoughness (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerNormal
[       OK ] MaterialCompiler.StaticCodeAnalyzerNormal (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerBentNormal
[       OK ] MaterialCompiler.StaticCodeAnalyzerBentNormal (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerOutputFactor
[       OK ] MaterialCompiler.StaticCodeAnalyzerOutputFactor (92 ms)
[ RUN      ] MaterialCompiler.StaticCodeAnalyzerWithinInclude
[       OK ] MaterialCompiler.StaticCodeAnalyzerWithinInclude (92 ms)
[ RUN      ] MaterialCompiler.EmptyName
[       OK ] MaterialCompiler.EmptyName (797 ms)
[ RUN      ] MaterialCompiler.Uv0AndUv1
[       OK ] MaterialCompiler.Uv0AndUv1 (760 ms)
[ RUN      ] MaterialCompiler.Arrays
[       OK ] MaterialCompiler.Arrays (643 ms)
[ RUN      ] MaterialCompiler.CustomSurfaceShadingRequiresLit
Error: customSurfaceShading can only be used with lit materials.
[       OK ] MaterialCompiler.CustomSurfaceShadingRequiresLit (1 ms)
[ RUN      ] MaterialCompiler.CustomSurfaceShadingRequiresFunction
ERROR: 0:1113: 'surfaceShading' : no matching overloaded function found
ERROR: 0:1113: '' : compilation terminated
ERROR: 2 compilation errors.  No code generated.

ERROR: Unable to parse fragment shader:
ERROR: 0:1086: 'surfaceShading' : no matching overloaded function found
ERROR: 0:1086: '' : compilation terminated
ERROR: 2 compilation errors.  No code generated.

[       OK ] MaterialCompiler.CustomSurfaceShadingRequiresFunction (57 ms)
[ RUN      ] MaterialCompiler.CustomSurfaceShadingHasFunction
[       OK ] MaterialCompiler.CustomSurfaceShadingHasFunction (523 ms)
[----------] 36 tests from MaterialCompiler (5561 ms total)

[----------] 11 tests from IncludeParser
[ RUN      ] IncludeParser.NoIncludes
[       OK ] IncludeParser.NoIncludes (0 ms)
[ RUN      ] IncludeParser.SingleInclude
[       OK ] IncludeParser.SingleInclude (0 ms)
[ RUN      ] IncludeParser.MultipleIncludes
[       OK ] IncludeParser.MultipleIncludes (0 ms)
[ RUN      ] IncludeParser.EmptyInclude
[       OK ] IncludeParser.EmptyInclude (0 ms)
[ RUN      ] IncludeParser.Whitepsace
[       OK ] IncludeParser.Whitepsace (0 ms)
[ RUN      ] IncludeParser.InvalidIncludes
[       OK ] IncludeParser.InvalidIncludes (0 ms)
[ RUN      ] IncludeParser.InvalidWithValidInclude
[       OK ] IncludeParser.InvalidWithValidInclude (0 ms)
[ RUN      ] IncludeParser.LineNumbers
[       OK ] IncludeParser.LineNumbers (0 ms)
[ RUN      ] IncludeParser.IncludeWithinStarComment
[       OK ] IncludeParser.IncludeWithinStarComment (0 ms)
[ RUN      ] IncludeParser.IncludeWithinSlashComment
[       OK ] IncludeParser.IncludeWithinSlashComment (0 ms)
[ RUN      ] IncludeParser.IncludeWithinBothSlashStarComments
[       OK ] IncludeParser.IncludeWithinBothSlashStarComments (0 ms)
[----------] 11 tests from IncludeParser (0 ms total)

[----------] 10 tests from IncludeResolver
[ RUN      ] IncludeResolver.NoIncludes
[       OK ] IncludeResolver.NoIncludes (0 ms)
[ RUN      ] IncludeResolver.SingleInclude
[       OK ] IncludeResolver.SingleInclude (0 ms)
[ RUN      ] IncludeResolver.MultipleIncludes
[       OK ] IncludeResolver.MultipleIncludes (0 ms)
[ RUN      ] IncludeResolver.IncludeWithinInclude
[       OK ] IncludeResolver.IncludeWithinInclude (0 ms)
[ RUN      ] IncludeResolver.Includers
[       OK ] IncludeResolver.Includers (0 ms)
[ RUN      ] IncludeResolver.IncludeFailure
The included file "two.h" could not be found.
The included file "one.h" could not be found.
[       OK ] IncludeResolver.IncludeFailure (0 ms)
[ RUN      ] IncludeResolver.Cycle
Include depth > 30. Include cycle?
[       OK ] IncludeResolver.Cycle (0 ms)
[ RUN      ] IncludeResolver.SingleIncludeLineDirective
[       OK ] IncludeResolver.SingleIncludeLineDirective (0 ms)
[ RUN      ] IncludeResolver.MultipleIncludesLineDirective
[       OK ] IncludeResolver.MultipleIncludesLineDirective (0 ms)
[ RUN      ] IncludeResolver.MultipleIncludesSameLineLineDirective
[       OK ] IncludeResolver.MultipleIncludesSameLineLineDirective (0 ms)
[----------] 10 tests from IncludeResolver (0 ms total)

[----------] 6 tests from MaterialBuilder
[ RUN      ] MaterialBuilder.NoIncluder
[       OK ] MaterialBuilder.NoIncluder (1 ms)
[ RUN      ] MaterialBuilder.Include
[       OK ] MaterialBuilder.Include (79 ms)
[ RUN      ] MaterialBuilder.IncludeVertex
[       OK ] MaterialBuilder.IncludeVertex (76 ms)
[ RUN      ] MaterialBuilder.IncludeWithinFunction
[       OK ] MaterialBuilder.IncludeWithinFunction (76 ms)
[ RUN      ] MaterialBuilder.IncludeFailure
The included file "nonexistent.h" could not be found.
[       OK ] MaterialBuilder.IncludeFailure (1 ms)
[ RUN      ] MaterialBuilder.NoShaderCode
[       OK ] MaterialBuilder.NoShaderCode (76 ms)
[----------] 6 tests from MaterialBuilder (311 ms total)

[----------] Global test environment tear-down
[==========] 65 tests from 5 test suites ran. (5874 ms total)
[  PASSED  ] 65 tests.
corrupted size vs. prev_size while consolidating
[1]    1203232 IOT instruction (core dumped)  ./test_filamat

Could be related to glslang  but we've never seen this issue before (we run those tests on every build). Are you still building Filament with your own changes and without using our build scripts?

@romainguy
Thank you for your prompt reply ^_^
I actually am rebuilding it again.
I just simply decompose your scripts (without any modification actually), but use a different compiler (GNU C++), only except (libfilament which is built with CLANG), everything else is built with GCC.

I actually failed test_utils as well.
./test_utils
......
....../filament/libs/utils/test/test_StructureOfArrays.cpp:123: Failure
Value of: soa.data<2>()[7] == destroyedFloat4
  Actual: false
Expected: true
[  FAILED  ] StructureOfArraysTest.Simple (0 ms)
......

you have to be careful when mixing compilers, there is no binary compatibility guarantees.

@pixelflinger @romainguy
I now still have this LAST isse, couldn't recall how I solve the problem last time:
https://github.com/google/filament/issues/5876.
When I ran the following tests,

test_filameshio
test_ktxreader
viewer - test_settings
filament - test_material_parser

I got the following ERROR messages:
/usr/bin/ld: /usr/local/filament/lib/libbackend.so: undefined reference to `filament::backend::HandleAllocator<16ul, 64ul, 208ul>::~HandleAllocator()'
/usr/bin/ld: /usr/local/filament/lib/libbackend.so: undefined reference to `filament::backend::HandleAllocator<16ul, 64ul, 208ul>::HandleAllocator(char const*, unsigned long)'
/usr/bin/ld: /usr/local/filament/lib/libbackend.so: undefined reference to `filament::backend::HandleAllocator<16ul, 64ul, 208ul>::deallocateHandleSlow(unsigned int, unsigned long)'
/usr/bin/ld: /usr/local/filament/lib/libbackend.so: undefined reference to `filament::backend::HandleAllocator<16ul, 64ul, 208ul>::handleToPointerSlow(unsigned int) const'
/usr/bin/ld: /usr/local/filament/lib/libbackend.so: undefined reference to `filament::backend::HandleAllocator<16ul, 64ul, 208ul>::allocateHandleSlow(unsigned long)'

where, /usr/local/filament/lib/libbackend.so was just built out from source ...

Solved...
-DFILAMENT_SUPPORTS_OPENGL=1


libz blitz: add html root url attribute to crate root

Should resolve #134

recommitted in #149 based on new docs api guideline.


Add ** router

Improve docs for Router
Add ** router that matches the whole route

Coverage decreased (-0.24%) to 91.95% when pulling 1ada4ac8d00d2dfbf43e458baadc86c8de87cf01 on match-all-router into 6a6432481cf65ad31ce42cc43bd632448fbbda0c on master.

Coverage decreased (-0.24%) to 91.95% when pulling 1ada4ac8d00d2dfbf43e458baadc86c8de87cf01 on match-all-router into 6a6432481cf65ad31ce42cc43bd632448fbbda0c on master.


Python builds without readline or openssl support

Problem
When installing python 2.7.9, readline and openssl modules are not built and installed.
Steps to reproduce
1. Install python:
asdf install 2.7.9`

2. Use python:
asdf local python 2.7.9

3. Launch interactive python and attempt to import the modules:
>>> import readline
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: No module named readline

>>> import ssl
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/Chris/.asdf/installs/python/2.7.9/lib/python2.7/ssl.py", line 97, in <module>
    import _ssl             # if we can't import it, let the error propagate
ImportError: No module named _ssl

You can also use the arrow keys and typical ctrl-* navigation commands and see the escape sequences being output.
Possible solution
Reviewing the build output, it looks the install script is setting openssl and readline options that aren't valid for python:
configure: WARNING: unrecognized options: --with-openssl-dir, --with-readline-dir, --disable-install-doc

I checked homebrew's python formula, and they are patching setup.py's readline and openssl configurations with paths to homebrew's versions.
It seems like this is the strategy required to fix this problem. Unfortunately, my bash skills aren't sharp enough to make the change myself and PR.

Turns out, setting the include and lib paths directly via environment variables fixes the issue:
echo "Building with options: $configure_options"

local readline_path=$(homebrew_package_path readline)
export CPPFLAGS="-I$readline_path/include ${CPPFLAGS}"
export LDFLAGS="-L$readline_path/lib ${LDFLAGS}"

local openssl_path=$(homebrew_package_path openssl)
export CPPFLAGS="-I$openssl_path/include ${CPPFLAGS}"
export LDFLAGS="-L$openssl_path/lib ${LDFLAGS}"

./configure $configure_options || exit 1
make -j $ASDF_CONCURRENCY || exit 1
make -j $ASDF_CONCURRENCY install || exit 1

I referenced pyenv's source for this fix. I wonder if a better solution would be to make this plugin a wrapper around python-build.

Hi, sorry for the late reply, and thank you for the heads-up!
I also think wrapping python-build seems more appropriate,
as they already probably dealt with all kind of issues.
I will try to update the plugin when I find the time!

I just updated the plugin to wrap python-build, please let me know how it works for you.

Just tried it out and worked great for me. Great work. Thanks!


slotItemTemplateResolver should return the item from the resources

Hello,
If I want to have a custom template on the resources table (left side of calendar) the method called by slotItemTemplateResolver is giving me and item with the following:
{
                slotId: ...,
                slotName: ....,
                rowHeight: ....,
                headerItems: ....
}

Even though I'm passing on schedulerData.setResources a complete object like:
{
                id: data.id,
                name: data.title,
                complexObject: {....}
}

When my custom template method is called I only get slotId, slotName etc... but i would like to have my object back the same as I set it on the schedulerData.setResources
The workaround for now is slotItemTemplateResolver is sending me back the id of my item and then i can search for it on my properties but I think the scheduler should return it as well.
Or maybe i have something wrong :)
Thank you so much!

@angel-git
Hi, you can use schedulerData.getSlotById(slotId) to get your complete object after you get the slotId:-)

that also works! thanks! ;)


new paramater on pokemon go server, fact or not.?

hai dev, this morning i have warning from redit about new parameter on pokemongo api
this true or not.? please info.
this capture from redit
https://postimg.org/image/jlpztxmt3/
https://m.reddit.com/r/pokemongo/comments/4u8efx/first_ban_wave_coming_soon/

They have been logging that from the start.


Dependency: SBI: CPPC Extension

Note this as an SBI requirement in the doc.
Depend on the PRS proposal.

Ok, I was somewhat hasty. The CPPC extension may be used by an ACPI CPPC implementation but does not have to be. So CPPC is not an SBI requirement.


[WIP, DO NOT MERGE] Adding documents to TE/JAX

/te_ci

/te_ci

/te-ci

@mingxu1067 @jeng1220 Looks like there are a lot of duplicate commits here, could you please rebase with main?

Since #54 is merged now, we can remove the WIP tag too

@mingxu1067 @jeng1220 Looks like there are a lot of duplicate commits here, could you please rebase with main?

@mingxu1067 ,
Could you update your branch first? So other colleagues can read the change easier and earlier.

/te-ci

Could we combine #88 with this PR? I think the scope of this PR is documentation and that change falls within this. I want to avoid burdening the ci with a bunch of small PRs especially when they can be combined. This would speed up the dev/review/merge process. @mingxu1067

@ksivaman, ok, merged #88 with this PR and close #88
.

/te_ci

/te-ci

/te-ci


add nanovg port

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: spacepluk sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

Thanks for the PR!


Split gutter color from current line highlighting

Category

[x] fzf binary
[ ] fzf-tmux script
[ ] Key bindings
[ ] Completion
[ ] Vim
[ ] Neovim
[ ] Etc.

OS

[x] Linux
[ ] Mac OS X
[ ] Windows
[ ] Windows Subsystem for Linux
[ ] Etc.

Shell

[x] bash
[ ] zsh
[ ] fish

Hi! I found #592 where you state that you don't plan to change ui elements any longer. However I was wondering if it is possible to add new color option for the "gutter" i.e split it from the current line highlight. In the image below I would like to highlight the current line in light blue but the gutter in black however I get both highlighted with light blue. Thanks in advance!

Thank you


cmd/go: "go env" becomes unusable after I run "go env -w" wrongly.

What version of Go are you using (go version)?

$ go version
go version go1.13.1 linux/amd64

Does this issue reproduce with the latest release?
true
What did you do?
$ go env -w GO111MODULE==on
$ go env
go: unknown environment setting GO111MODULE==on
$ go env -w GO111MODULE=on
go: unknown environment setting GO111MODULE==on
$ go env -w GO111MODULE=
go: unknown environment setting GO111MODULE==on

This seems to me like a variation of #34194; that involved an invalid GOOS/GOARCH pair, while this seems to involve an unknown variable name.
/cc @bcmills @jayconrod

On second thought, this involves an invalid GO111MODULE value. Sent a CL.


VTOL: add parameter to set the PWM_OUTPUT_DEVICE_PATH

This PR enables the use of the FMU (AUX) output for the multicopter motors on standard VTOL and tiltrotors.
The device path is needed to apply PWM limits on the motors that are not
used for FW flight (switch them off). With this parameter the device path can be set
to either IO or FMU, depending on whether the motors are on the IO or FMU port.

@dagar or would you have a better idea instead of a parameter to achieve that?

@dagar or would you have a better idea instead of a parameter to achieve that?

Nothing that isn't significantly more invasive. We'll find a better way to handle all of this holistically, but it's going to take some time.

@dagar or would you have a better idea instead of a parameter to achieve that?

Nothing that isn't significantly more invasive. We'll find a better way to handle all of this holistically, but it's going to take some time.

One way to (hopefully soonish) be able to solve it would be the control allocation.

@sfuhrer Does this need docs? I would have said yes because what is written above is meaningless to me. My understanding was that allocation of outputs was defined by the mixer and includes MC stuff. So the need for this is unclear.

@hamishwillee Historically the vtol controller was messing around with pwm outputs directly as the mixer interface was not designed for the functionality we need for vtol.
Now, the vtol controller was always using the "/dev/pwm_output0" for the aforementioned hackery. For boards which have an IO and an FMU output device the IO was mapped to "/dev/pwm_output0" and the FMU was mapped to "/dev/pwm_output1". So the requirement was to connect the hover motors to IO as the vtol controller was always using that device.
This PR enables the vtol controller to use either of the devices, so you can now also connect the motors to the FMU if you want to.

@RomanBapst (& @sfuhrer ) The problem here is that the docs don't mention the limitation at all, so not really clear where this should be extended.
I think "we" (meaning you :-) ) need to add a "VTOL Mixer" section under syntax explaining how you define a VTOL mixer - limitations/whatever and mentioning you need to set this parameter as well.
Can you do that?
I would do it but I bet there is more to it than just "define a multcopter mixer and an FW mixer(s), particularly for tailsitters etc. Though here is some idea of what it might look like.
## VTOL Mixer

A standard quadplane mixer is defined as a multicopter mixer and as a separate "Fixed wing mixer" (i.e. made up from a number of summing mixers).
Historically these had to be separately defined in the MAIN mixer and AUX mixer files (respectively).
From PX4v1.11 the multicopter can now be defined in the AUX file, if `VT_MC_ON_FMU` is enabled.

<Whatever you want to say about tiltrotor and tailsitter ???? >

Thoughts?

@RomanBapst @sfuhrer ^^^^ Please see that last comment

@hamishwillee I would propose something like this:
VTOL Mixer
The mixer system for a VTOL vehicle can be either combined into a single mixer where all the actuators are connected to either the IO or the FMU port, or split into two separate ones, one for IO and one for AUX. If separated, it is recommended that all the multicopter motors are one one, and all the servos and the fixed-wing motor on the other. Use the multirotor mixers for the multirotor mixers, and the summing mixers for the fixed-wing actuators (plus the tilting servos in case of a tiltrotor VTOL).
If you want to use the FMU output for the multicopter motors (only possible since PX4v1.11), you need to set VT_MC_ON_FMU to 1, as they are otherwise not switched off when in fixed-wing flight mode.

Thanks. Slightly modified version of your doc suggestion for review in https://github.com/PX4/Devguide/pull/1042


Documentation for topic platform.notifications.ingress

Description
Documentation for topic platform.notifications.ingress
dependencies that are required for this change.
Type of change

Documentation update

Testing steps
See https://redhatinsights.github.io/insights-results-smart-proxy/overall-architecture.html after merge.
Checklist

[ ] make before_commit passes
[ ] updated documentation wherever necessary
[ ] added or modified tests if necessary
[ ] updated schemas and validators in insights-data-schemas in case of input/output change

Codecov Report
Base: 60.50% // Head: 60.43% // Decreases project coverage by -0.06% :warning:

Coverage data is based on head (dae6f10) compared to base (c6741f1).
 Consider uploading reports for the commit 19bd4a0 to get more accurate results

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #964      +/-   ##
==========================================
- Coverage   60.50%   60.43%   -0.07%
==========================================
  Files          23       23
  Lines        3228     3228
==========================================
- Hits         1953     1951       -2
- Misses       1054     1056       +2
  Partials      221      221

Impacted Files
Coverage Δ

content/content.go
76.95% <0.00%> (-0.83%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Fixes issue 2230: Only catchup signatures since the last payment block

Once payment has been made to validators for signed blocks then signatures will not be added by the catchup task.

I think we should wait until the block-reward is merged in, because:

block reward also depends on the number of validators
the payout period for the block reward can be different from the tx fee

in fact I think tx fee only depends on whether someone shared a preimage or not, it doesn't depend on signature

I think we should wait until the block-reward is merged in (and revisited), because:

block reward also depends on the number of validators
the payout period for the block reward can be different from the tx fee

ok I'll take a look at your PR to get some more understanding of what is changing. Perhaps we can also have whiteboard about it at some time soon.

@ferencdg Even though the param used may be updated with your PR I still think this is an improvement from having a hard-coded number of blocks. I think this can be merged first and then later we can adjust as required. What do you think?

@ferencdg Even though the param used may be updated with your PR I still think this is an improvement from having a hard-coded number of blocks. I think this can be merged first and then later we can adjust as required. What do you think?

sure, but I think we should raise a follow up ticket, so we don't forget


RMX2020-Evolution-X-tiramisu-rinto02

Build Evolution X for RMX2020

Build Evolution X for X2020

Build Evolution X for RMX2020


Fix migrations

Migrations don't work in python 3 if they contain bytestrings. So replace all bytestrings by unicode strings.

Automated message from Dropbox CLA bot
@sharmaeklavya2, it looks like you've already signed the Dropbox CLA. Thanks!

This is the error which made me do the last commit (Squash an AlterField from 0002 into 0001): https://travis-ci.org/sharmaeklavya2/zulip/jobs/141965334

Haven't had a chance to investigate in detail, but we could consider using this approach to squash older migrations in general; might be a cleaner solution to that problem:
https://docs.djangoproject.com/en/1.8/topics/migrations/#squashing-migrations

I merged all but the last commit; for the last commit, I think we should evaluate the above approach (while nobody is on migration 1 and thus this shouldn't break anything, I'm not convinced moving things between migrations is a good approach)

Yeah I think you're right that manually moving things between migrations might break individual migrations. But the AlterField operation which I squashed from 0002 to 0001 was just a change in help text. I think each migration is still correct in itself. (If instead of the help text it would have been something else, like the type of a field or a database constraint, there was a chance of destabilizing 0001.)
Even I wasn't keen on moving a change between migrations, but couldn't see any other way out and no harm in my approach since no one is on migration 0001. If you can suggest a better way to do this, that'll be great. But if we can't come up with something quickly, we should move on with this change, since adding python 3 support is important.

OK, that seems reasonable, so I've gone ahead and merged that as well.  Hopefully we won't run into more additional similar problems where a more complex solution is required.


More data from GOT10 (OBD2)

Hi, i just found your traccar project, and it works fine with my GOT10 device.
Would you please add obd2 features to your webserver/database/interface like, the GOT10 device has in its original webinterface here. http://www.keelin.com.cn/
Here is the communication protocol pdf, and if you need i can provide whireshark dump files.
http://www.eelink.com.cn/uploads/datasheet/EELINK_Terminal_Communication_Protocol_V1.8.4_EN.pdf

Hi vzoltan,
Do you have the latest firmware for your device, or do you know where to get it?
Thanks,
Bruno

Hi, i have no idea what is the version of the firmware i use. How can i check it?
Az iPademről küldve

ápr. 19. dátummal, 12:45 időpontban Bruno Pires<EMAIL_ADDRESS>írta:

Hi vzoltan,
Do you have the latest firmware for your device, or do you know where to get it?
Thanks,
Bruno
—
Reply to this email directly or view it on GitHub.

Hi,
Send an SMS to the device with the text "VERSION#"

Do you have access to Eelink http://keelin.com.cn or http://www.sky200.com platforms?

It has no credit on it, wont answear :)

Thanks anyway :)

What version do you have and what is the difference between versions?

The device has v1.8.4 and i need to install v1.8.5 to have access to the DTC fault codes

Mine is:
SYSTEM:M5000_V1.8.8
VERSION:MXAPP_V1.8.9
BUILD_Sep 25 2014 18:53:52
update command is:
UPGRADE,C4_EXT.exf,www.sky200.com,69#
size is about 91kb

Hello vzoltan,
would you share the upgrade file? i'm getting always timeout when trying to update, and i'm stuck with a faulty 1.8.4 version that is draining my car battery.
Thanks

i dont have an upgrade file.
i just sent the command via sms to the device and it updated itself.
but that was 2 years ago.


add back E2E to CI

Summary:

What: add back e2e tests to github actions (note this was @ckmoga 's pr primarily)
Ticket: sc<fill_in_issue_number>
Env: <rdev link>

Demos:
Notes:
Checklist:

[x] I merged latest <base branch>
[x] I manually verified the change
[ ] I added labels to my PR
[ ] I tested in multiple browsers
[ ] I added relevant unit tests
[ ] I have notified others of changes they need to make locally (migrations, jobs, package updates, etc)

@ckmoga can you help me fix this e2e test issue? This test case must have changed a little since i merged trunk


Support cssnextrc

Babel does it and it is awesome. Doing so babel is able to share config through every 3rd party integration libraries.
So please, give us the ability to mimic this behavior with cssnext!

:+1:

Closing in favor of #73

My bad

Please guys, express yourselves about the format you would like to have ;)


DHCP in initrd does not wait for network device to appear

Describe the bug
Using initrd networking on a low-end device (Raspberry Pi 3B+), DHCP networking fails because it executes before the device appears. The following fails with ip: SIOCGIFFLAGS: No such device and udhcpc: SIOCGIFINDEX: No such device.
{ boot.initrd.network.enable = true;
  networking.useDHCP = false;
  networking.interfaces.eth0.useDHCP = true; }

While the following will first fail to enable eth0 a few times but eventually succeed.
{ boot.initrd.network.enable = true;
  boot.initrd.network.postCommands = ''
   until ip link set eth0 up; do sleep .1; done
   ip addr add <...> dev eth0
   ip route add default via <...> dev eth0
  ''; }

To Reproduce
Get a Raspberry Pi 3B+ and try the configurations above. Don't forget boot.initrd.kernelModules = [ "smsc95xx" "usbnet" ];.
Expected behavior
Expect DHCP to wait for interfaces to appear, here:
https://github.com/NixOS/nixpkgs/blob/236eb73d1bd3bd734995c51acd2ec0611f5af64f/nixos/modules/system/boot/initrd-network.nix#L123-L135
Notify maintainers
@fpletz and @edolstra, according to git blame.
Maintainer information:
# a list of nixpkgs attributes affected by the problem
attribute:
- boot.initrd.network.enable
# a list of nixos modules affected by the problem
module:
- system/boot/initrd-network.nix

I'm happy to submit a PR, but I'm wondering:

Is there a way to determine when or wait until network devices appear? Maybe check if /sys/class/net is populated?
Otherwise, how about a boot.initrd.network.waitForInterfaces option defaulting to false that may be set to true or a list of interfaces?

In the meantime, the following might be used as a workaround:
boot.initrd.preLVMCommands = lib.mkBefore 400 "sleep 1";

Still, there's a race here and I'd like to get rid of it. I tried udevadm settle instead but it didn't work.

Not stale, this is still relevant.  As I understand it, this bug means it is difficult to set up full-disk encryption on headless systems where you need to ssh in and provide a passphrase at startup.

Correct.  I'm experiencing it on fairly vanilla x86_64 hardware, supermicro M11SDV-4CT-LN4F, 4 interfaces using the "igb" driver, my ethernet connection is on eth0.  I don't have a log/screenshot handy, but the symptom is essentially the same as the OP.
I attempted @matthias-t 's workaround, but
error: attempt to call something which is not a function but a set, at /etc/nixos/configuration.nix:13:28

Maybe that usage is no longer correct?  I'm on 20.09.3588.d395190b24b (Nightingale)

Looking at lib/modules.nix it seems mkBefore has been renamed to mkOrder.

I'm experiencing the same problem on a Raspberry Pi 3B non-plus. The workaround suggested by @matthias-t works for me, however, I'm unable to SSH into my machine afterwards. ifconfig shows that it brought up the interface eth0 but acquired some weird IP address that is not included in the subnet of my router. The kernel ring buffer also shows this error message:
ERROR::assign_and_init_hc:1434: assign_and_init_hc: Failed to allocate memory to handle non-dword aligned buffer case

Not stale, problem still exists


Using placeholders in UAA_CONFIG_YAML

Trying to understand how to use placeholders to set SMTP credentials within the UAA_CONFIG_YAML for a bound service sendgrid on PWS.
 smtp:    host: ${vcap.services.smtpdev.credentials.hostname:localhost}    port: 2525    user: ${vcap.services.smtpdev.credentials.username:user}    password: ${vcap.services.smtpdev.credentials.password:password}
Caused by: javax.mail.MessagingException: Could not connect to SMTP host: localhost, port: 2525;
auto_reconfig is enabled and it's successfully binding the app to the mysql service.

Even after providing details of new SMTP servers in UAA_CONFIG_YAML, why its picking default values like host:localhost and port:2525?

Right, it never used the vcap_services values and always picked the defaults.

I changed the value of it in build.gradle file and it works for me.

You changed the value to what? You used the placeholders?

I am just evaluating the software for my case. That's why I hardcoded the actual value. But I think we can put placeholders instead which is the best practice.

Agree it's best practice but I don't think it works

I tried using placeholders in the Uaa.yml and the uaa_config_yml and it never worked. It takes hard coded values fine but isn't a good idea as the smtp credentials will end up in a repo.

@plfx Can you comment?

@miclip Are you using UAA's Bosh release (from the uaa-release repo), or UAA directly from theuaa repo?

Directly from the repo.

@miclip We don't support variable substitution in the Yaml configuration files. These contain values.
However, you can set environment variables for almost any variable that we have that is configurable.
For example
smtp:
  host: localhost

Can be written as smtp.host system property or SMTP_HOST environment variable.
So for a CF application, you can set the env variable SMTP_HOST to override the default


Fast dash bug

I can't use dash in god home

And the door default begin is useless,too

If you're using Scarab, first try re-installing (uninstall, then install) this mod and its dependencies (Satchel, Osmi & HKMirror).
If the problem persists, please first try re-produce the unintended behaviour, then post the ModLog.txt file which contains necessary information for debugging.

ModLog.txt Location
Windows: %APPDATA%\..\LocalLow\Team Cherry\Hollow Knight\
Mac OS: ~/Library/Application Support/unity.Team Cherry.Hollow Knight/
Linux: ~/.config/unity3d/Team Cherry/Hollow Knight/

I can't use dash in god home

Closed due to no further information be given.


npm run watch .js error file

When I run command "npm run watch" or "npm run watch-poll", the script generates a bugged .js file, and the browser console shows "Uncaught SyntaxError: Invalid or unexpected token".
If I try to open the js file with Sublime Text (Finder show me Zero KB), seems that the script falls in a never ending loop writing in the js file null and after the compiled js script, null and so on...
No problem running the "npm run watch" with only the scss files or, with the js, running "npm run dev".
Here's my configs:
Node: 8.1.4
NPM: 5.5.1
Laravel mix: 1.5.0
Webpack.mix.js:
const {mix} = require('laravel-mix');
const dotenv = require('dotenv-webpack');

mix.webpackConfig({
    plugins: [
        new dotenv({
            path: './.env', // Path to .env file (this is the default)
            safe: true // load .env.example (defaults to "false" which does not use dotenv-safe)
        })
    ]
})
    .js('./resources/assets/javascripts/app.js', './public/assets/javascripts/web.min.js')
    .sass('./resources/assets/stylesheets/main.scss', './public/assets/stylesheets/main.min.css')
    .scripts([
            './public/assets/javascripts/web.min.js',
            './node_modules/jquery-migrate/dist/jquery-migrate.min.js',
            './node_modules/jquery.stellar/jquery.stellar.js'
        ], './public/assets/javascripts/web.min.js'
    )
    .extract([
        'axios',
        'jquery',
        'lodash',
        'vue'
    ]);

HELP ME!

why you trying to pack your output script. web.min.js
it's not valid code

So what can I do? How can I fix it?

One of the possible solutions in my option.

Remove scripts
Import you deps directly in app.js

import 'jquery-migrate';
import 'jquery.stellar';

Good!
Another problem is importing jquery-migrate generates an error "define cannot be used indirect". So I pack the code for this reason.

So that is an issue with jquery-migrate ^3.0.1+ - https://github.com/jquery/jquery-migrate/issues/273
You should require 3.0.0 (without^) in your package.json
or disable amd import for this lib
mix.webpackConfig({
 module: {
        rules: [
            {
                test: require.resolve("jquery-migrate"),
                use: "imports-loader?define=>false",
            }
        ],
    },
})

WORKS FINE! Thanx

no way


Question: Is it possible to extract inclusion probabilities of predictors from trained model?

Hi,
thank you all your efforts in developing this library
Previously, we used Google's initial R library, CausalImpact, for causal inference. Now, we're in search of a good substitute for it in Python, and this library seems like an excellent option. In the initial R library, there is functionality to extract posterior inclusion probabilities of predictors from the trained model. We use these probabilities as additional descriptive statistics to fine-tune the model and exclude certain predictors from the control group.
I'm curious if there's an approach to extract these posterior inclusion probabilities of predictors in tfcausalimpact. Your guidance on this matter would be immensely helpful.
Just R code to demonstrate what exactly I mean:
library(CausalImpact)

set.seed(1)
x1 <- 100 + arima.sim(model = list(ar = 0.88), n = 100)
x2 <- arima.sim(model = list(ar = 0.22), n = 100) + rnorm(100)
x3 <- rnorm(100) + rnorm(100, mean = 80, sd = 10)

y <- 1.2 * (x1+x2+x3)/3 + rnorm(100)

y[71:100] <- y[71:100] + 60
data <- cbind(y, x1, x2, x3)

pre.period <- c(1, 70)
post.period <- c(71, 100)

impact <- CausalImpact(data, pre.period, post.period)
plot(impact$model$bsts.model, "coefficients")

Hi @hnasko ,
It is possible to extract the posterior of the weights. Please refer to the getting_started notebook section 2.5 where this is discussed:

If you used the default Hamiltonian method then this code should retrieve the posterior samples averaged:
tf.reduce_mean(ci.model.components_by_name['SparseLinearRegression/'].params_to_weights(
    ci.model_samples['SparseLinearRegression/_global_scale_variance'],
    ci.model_samples['SparseLinearRegression/_global_scale_noncentered'],
    ci.model_samples['SparseLinearRegression/_local_scale_variances'],
    ci.model_samples['SparseLinearRegression/_local_scales_noncentered'],
    ci.model_samples['SparseLinearRegression/_weights_noncentered'],
), axis=0)

Let me know if this solves for you.


Add clone support for registrations

Utilizes a redirect in APIv2 to avoid osf-cli needing to know whether a GUID refers to a node or a registration object.
Manually tested to verify this:

works
does not break file uploads.

Introduces a small side effect: provide a file GUID, and it breaks. It would have broken before, this just makes it break in a different place.

Probably need to update some of the tests/mocks.
Should we make a new method called guid with a doc string that says that it can be used for things other than projects? Then update the CLI part to use guid() when clone'ing instead of project()?

Codecov Report

Merging #134 into master will not change coverage.
The diff coverage is 100%.

@@           Coverage Diff           @@
##           master     #134   +/-   ##
=======================================
  Coverage   93.16%   93.16%
=======================================
  Files          13       13
  Lines         541      541
=======================================
  Hits          504      504
  Misses         37       37

Impacted Files
Coverage Δ

osfclient/api.py
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e5ee584...bb5525d. Read the comment docs.

I'd leave project() as it is so that you can only use it to get projects (and registrations). Instead we add a new guid(a_guid) method which can take a GUID for any kind of object and then inspects the returned JSON to instantiate the right type.
If we want to work towards a more git-like CLI it might be worth keeping osf clone the way it is aka it only clones whole projects (or registrations). osf fetch could fetch 'random' GUIDs?? So we need to put some logic into the CLI part to deal with trying to fetch a project or a registration.

I'll merge this as is. We can improve on it later.

Congratulations on your first contribution! We operate under what is often called "the pull request hack". Basically once some of your work has been merged we add you to the list of people who can merge other's work. Would that be Ok with you?

Sound good to me

With great power comes great responsibility! :) Welcome to the team.


undefined method `pledges=' for nil:NilClass

After upgrading the Patreon gem to v0.3.0, performing the OAuth flow using the following code snippet throws an exception on the last line during the callback to my service. Downgrading the Patreon gem to v0.2.0 solves the error.
Initial sendover:
redirect_to("https://www.patreon.com/oauth2/authorize?response_type=code&client_id=#{ENV['PATREON_CLIENT_ID']}&redirect_uri=#{redirect_uri}")

Callback:
oauth_client = Patreon::OAuth.new(ENV['PATREON_CLIENT_ID'], ENV['PATREON_CLIENT_SECRET'])

tokens = oauth_client.get_tokens(params[:code], redirect_uri)
access_token = tokens['access_token']
refresh_token = tokens['refresh_token']

api_client = Patreon::API.new(access_token)
user_response = api_client.fetch_user() # raises exception

undefined method `pledges=' for nil:NilClass

app/controllers/patreon_users_controller.rb:16:in `in' # the user_response line

I don't see any patch notes so I'm unsure if this is an intentional change in how the gem should be used, or a bug.
I'm running Rails 5.1.4 on Ruby 2.4.2. Full trace is below.  I updated the url to use /api instead, and now it's working (for me at least). The pull request is over here https://github.com/Patreon/patreon-ruby/pull/8. Can you try this out and let me know if it fixes it for you?

Hey, actually, I don't think that will help you. Instead, if possible can you run with DEBUG=1 set in your env (and use master of this gem). It will capture some debug output, and then, if you don't mind using some secure method, or cutting out the tokens, I think that will help us track down the issue.

Seeing this issue as well. Using master branch from github didn't help.

Getting this error as well.
@joshbuddy
I re-ran it with DEBUG=1. I'm not very familiar with these responses and am not sure which parts are sensitive data. Do you have any secure methods you recommend for sharing the output?

Encountering the same problem here. Appears to be an issue with JSON::Api::Vanilla.parse. Why not just use native Ruby JSON.parse?
From: /patreon-ruby/lib/patreon/api.rb @ line 34 Patreon::API#get_parse_json:
31: def get_parse_json(suffix)
32:   json = get_json(suffix)
33:   binding.pry

=> 34:   parse_json(json)
35: end
[1] pry(#<Patreon::API>)> json
=> "{\n    \"data\": {\n        \"attributes\": {\n            \"about\": null,\n            \"created\": \"2017-03-27T22:39:59+00:00\",\n            \"discord_id\": null,\n            \"email\": \"wak@wakproductions.com\",\n            \"facebook\": null,\n            \"facebook_id\": null,\n            \"first_name\": \"Greenspud\",\n            \"full_name\": \"Greenspud Trades\",\n            \"gender\": 0,\n            \"has_password\": true,\n            \"image_url\": \"https://c10.patreonusercontent.com/3/eyJ2IjoiMSIsInciOjIwMH0%3D/patreon-media/user/5462977/a152f52e08ec4099b3212547e377a954?token-time=2145916800&token-hash=96pPoipGZzm6gTSV1dzdQsuIr47TbCzn1wzvW_7UAog%3D\",\n            \"is_deleted\": false,\n            \"is_email_verified\": true,\n            \"is_nuked\": false,\n            \"is_suspended\": false,\n            \"last_name\": \"Trades\",\n            \"social_connections\": {\n                \"deviantart\": null,\n                \"discord\": null,\n                \"facebook\": null,\n                \"spotify\": null,\n                \"twitch\": null,\n                \"twitter\": null,\n                \"youtube\": null\n            },\n            \"thumb_url\": \"https://c10.patreonusercontent.com/3/eyJoIjoxMDAsInYiOiIxIiwidyI6MTAwfQ%3D%3D/patreon-media/user/5462977/a152f52e08ec4099b3212547e377a954?token-time=2145916800&token-hash=FioodKfrYEtzdXUmk5EXJ8KpY3PIKtJFeG6HaIbjZJA%3D\",\n            \"twitch\": null,\n            \"twitter\": null,\n            \"url\": \"https://www.patreon.com/greenspudtrades\",\n            \"vanity\": \"greenspudtrades\",\n            \"youtube\": null\n        },\n        \"id\": \"5462977\",\n        \"relationships\": {\n            \"pledges\": {\n                \"data\": []\n            }\n        },\n        \"type\": \"user\"\n    },\n    \"links\": {\n        \"self\": \"https://www.patreon.com/api/user/5462977\"\n    }\n}"

[3] pry(#<Patreon::API>)> JSON::Api::Vanilla.parse(json)
NoMethodError: undefined method `pledges=' for nil:NilClass

Can confirm that this is issue with JSON::Api::Vanilla.parse. I have the same issue in another place #23
JSON::Api::Vanilla has issue opened https://github.com/trainline/json-api-vanilla/issues/4 from some time ago.
Patreon should drop this dependency.

Temporary workaround:
In Gemfile use my fork:
# Patreon
gem 'patreon', git: 'https://github.com/hovancik/patreon-ruby', branch: 'feature/remove-json-api-vanilla'

Then update your code to not use broken json-api-vanilla, ie to get all your patron IDs:
      api_client = Patreon::API.new(ENV.fetch('PATREON_ACCESS_TOKEN'))
      campaign_response = api_client.fetch_campaign
      campaign_id = campaign_response['data'][0]['id']
      all_pledges = []
      cursor = nil
      loop do
        page_response = api_client.fetch_page_of_pledges(campaign_id, count: 25, cursor: cursor)
        all_pledges += page_response['data']
        next_page_link = page_response['links']['next']
        break unless next_page_link
        parsed_query = CGI::parse(next_page_link)
        cursor = parsed_query['page[cursor]'][0]
      end
      all_pledges.map { |pledge| pledge['relationships']['patron']['data']['id'] }

Thanks @hovancik . I was getting crazy with the Vanilla parse. This workaround works great.


Maximum call stack exceeded

Hi,
I'm sorry if this is normal behaviour due to javascript, but is the following case due to a bug or not:
I've build a component-based system based on Bacon, where each component can have IN/OUT ports. These are implemented using Bacon.Bus.
Whenever i create a loop (by connecting a component's OUT port to it's own IN port, i get a 'Uncaught RangeError: Maximum call stack size exceeded' within a second.
What exactly is going on behind the scenes? Why do i get this error? Each INport is just using bus.onValue(func) where func does a bus.push(data) to the OUTport's bus.

If I understand you correctly, you're pushing in an onValue handler to the same bus whose handler it is. This will lead to infinite recursion, which begs the question what are you trying to do? A code example may also clarify things a bit.

Consider this example,
Let's say i just want to create a counter that prints on the screen forever, and counts as fast as the system allows.

I would do this by creating a loop on the counter component. Intervaltrigger will send 1 signal, counter will process this and keep sending signals to itself, while also to the printer.
Each port you see here is a bus, and i don't want the potential loop to create a 'Uncaught RangeError: Maximum call stack size exceeded', I would expect that it would just keep counting

There's no tail recursion optimization, so pushing a new event in a handler won't allow the handler to return before the handler is triggered for a new event, causing unbounded stack growth. What to do depends on the case, I suggest to have a look at Bacon.repeat for generating events.

What happens if you use a zero-time delay the feedback part (dotted line)?
Also try to include a small code example as something concrete, or we'll have a hard time getting to what you want since (I believe) we have not really defined precise semantics for this type of "fixpoints" of streams.

Here's a generic fix-point combinator you can use to make a self-referential counter. The delay(0) in the counter will be necessary unfortunately, the story around synchronously occuring events is not good enough to support this.
Bacon.fix = f => {
  return new Bacon.EventStream(sink => {
    const bus = new Bacon.Bus();
    return f(bus).subscribe(ev => {
      sink(ev);
      if (ev.isNext()) bus.push(ev.value());
      else if (ev.isEnd()) bus.end();
      else if (ev.isError()) bus.error(ev.error)
    });
  });
};

const counter = Bacon.fix(input => {
  return Bacon.once(1).merge(input.map(x => x + 1)).delay(0);
});

counter.take(10000).log() // successfully prints numbers 1...10000

I'm closing this, I don't see us supporting this to a better extent.


improve our 403 error message

Similar fidesplus PR here
Description Of Changes
Small QOL update - improves our 403 error message when an oauth client does not have sufficient permissions for an action to indicate the scopes required for the action, to help troubleshooting and make the API more self-documenting.
Also, while I've been doing some scope troubleshooting, I realized that we don't have a great way of keeping our public facing docs up to date with changes in our app's actual scope registry. For now, I think a reminder on our PR template may be a good way to nudge us to keep those up to date.
Code Changes

[x] return the required scopes in the 403 error message sent back to the end user
[x] small update to our PR template for a reminder that public-facing docs need to be manually updated to reflect new scopes that are added to the app

Steps to Confirm

[x] tried an API call for an endpoint that an oauth client i created doesn't have access to - error message looks solid:

 curl -i -X 'GET' \
  'http://localhost:8080/api/v1/oauth/client/e511fe11ba99e39b089c65ebc60754e5/scope' \
  -H 'accept: application/json'  -H 'Authorization: Bearer $TOKEN'
HTTP/1.1 403 Forbidden
date: Wed, 22 May 2024 15:25:36 GMT
server: uvicorn
content-length: 77
content-type: application/json
x-ratelimit-limit: 1000
x-ratelimit-remaining: 999
x-ratelimit-reset:<PHONE_NUMBER>
retry-after: Wed, 22 May 2024 15:26:38 -0000

{"detail":"Not Authorized for this action. Required scope(s): [client:read]"}

In order to do this locally, roughly follow the steps listed here, i.e.:

start your local server: nox -s "build(slim)" "dev(slim)" -- dev
go to swagger UI docs at http://localhost:8080/docs, login with root oauth client creds: fidesadmin: fidesadminsecret
use the create client POST /api/v1/oauth/client endpoint to create a new oauth client, passing in a limited set of scopes in the request body, e.g.

["privacy-request:read"]

copy the client_id and client_secret of the created client (i.e. in the response body of that API call), and use them as the appropriate form fields in a POST /api/v1/oauth/token request, in order to acquire an access token for your new client
copy the access token, and use it as a bearer auth token in making an API call (easier via cURL now) that your client does not have the necessary scopes to make, e.g. GET /api/v1/connection. Note the error message that you get in your 403 response. it should look like:

 curl -i -X 'GET' \
  'http://localhost:8080/api/v1/connection' \
  -H 'accept: application/json'  -H 'Authorization: Bearer $ACCESS_TOKEN_RETRIEVED_ABOVE'
HTTP/1.1 403 Forbidden
date: Thu, 23 May 2024 18:44:35 GMT
server: uvicorn
content-length: 81
content-type: application/json
x-ratelimit-limit: 1000
x-ratelimit-remaining: 999
x-ratelimit-reset:<PHONE_NUMBER>
retry-after: Thu, 23 May 2024 18:45:36 -0000

{"detail":"Not Authorized for this action. Required scope(s): [connection:read]"}

Pre-Merge Checklist

[x] All CI Pipelines Succeeded
Documentation:

[ ] documentation complete, PR opened in fidesdocs
[ ] documentation issue created in fidesdocs

[ ] Issue Requirements are Met
[ ] Relevant Follow-Up Issues Created
[x] Update CHANGELOG.md
[ ] For API changes, the Postman collection has been updated

@andres-torres-marroquin - i thought this small tweak in one of our auth overrides may be a nice PR to start diving into our auth layer a bit! let me know if you've got any questions 👍
there's a corresponding fidesplus PR too that updates some very rarely used code


Feature request: marks on overencumberence and H.overencumberence

Just like sheet companion script is capable of placing green/red dots over token in case of (dis)advantage to track it - I propose some other icons being placed when character go over critical encumberence values.
Of course imho it should be toggleable, like ammo usage in settings.

This would be a feature for Lucian's script. That can affect the token. The sheet can't.

Should I post this request somewhere else ? I presume it's Lucian who maintain shaped sheet's companion script ? And yeah, I understand that sheet itself can't do such things. I meant the option for toggling could be in sheet's settings.

Sheet settings are only for things that impact the sheet. Ammo for example reduces ammo by 1 in the roll template so it has to have a sheet setting.
There are a myriad of script settings that don't have a sheet setting and this would be one of them.
It seems Lucian has an issue for this https://github.com/symposion/roll20-shaped-scripts/issues/257


googleapis.com font urls need to be requested with https

Easy to fix yet important issue
Because googleapis.com is requested with http protocol rather than https "Insecure content blocked" security error is reported by google chrome. This message alone looks pretty scary.

To fix the issue https needs to be used in following links links in head.html

fixed by 1ee7ef6aeb67d1227dbd24bc28dd97eb6eee48e2


Why does pallet_democracy use a Vec instead of BoundedVec as votes?

https://github.com/paritytech/substrate/blob/435218f5c4d0045d92d094641c915c31513cf2bf/frame/democracy/src/vote.rs#L140
Couldn't we use a BoundedVec here? Why do we need a Vec here? The bound would be the maximum number of votes.
From here:
https://github.com/paritytech/substrate/blob/435218f5c4d0045d92d094641c915c31513cf2bf/frame/democracy/src/lib.rs#L1389-L1392

@Chralt98 yes it should. There is a tracking issue to make all of these pallets use all bounded storage, and democracy is still in progress: https://github.com/paritytech/substrate/issues/8629


Unable to login with the provided credentials

Hi !
I'm discovering deployer from this morning and I'm dealing with a connection problem.
Here my code :
<?php

// All Deployer recipes are based on `recipe/common.php`.
require 'recipe/wordpress.php';

// Define a server for deployment.
// Let's name it "prod" and use port 22.
server('prod', 'http://xxxxxxx.local', 22)
    ->user('vagrant')
    ->password('vagrant')
    ->forwardAgent() // You can use identity key, ssh config, or username/password to auth on the server.
    ->stage('production')
    ->env('deploy_path', '/vagrant/wordpress'); // Define the base path to deploy your project to.

// Specify the repository from which to download your project's code.
// The server needs to have git installed for this to work.
// If you're not using a forward agent, then the server has to be able to clone
// your project from this repository.
set('repository', 'git@xxxxxxxx.git');

Deployer returns :
[RuntimeException]
Unable to login with the provided credentials.

I've tried my connection by ssh and it's working !
Thanks :)

server('prod', 'http://xxxxxxx.local', 22)

Why http://? Set your server hostname.

My bad !
Wrong copy/paste file.
So, always the same problem.

How about removing ->forwardAgent()?

That's it !
Thanks a lot for your reactivity.
Have a nice day :)


Issue on intercepting ajax request

I got problem intercepting ajax request when adding some additional header. If I remove the header addition, request would be continued, otherwise request was stopped.
[✓] Flutter (Channel stable, v1.12.13+hotfix.5, on Linux, locale en_US.UTF-8)
[✓] Android toolchain - develop for Android devices (Android SDK version 29.0.2)
[✓] Android Studio (version 3.5)
[✓] VS Code (version 1.35.0)
flutter_inappwebview: ^2.1.0+1
android: AndroidInAppWebViewOptions(
    domStorageEnabled: true,
    databaseEnabled: true,
    clearSessionCache: false,
),
crossPlatform: InAppWebViewOptions(
    userAgent: DotEnv().env['DEFAULT_UA'],
    debuggingEnabled: true,
    javaScriptCanOpenWindowsAutomatically: true,
    preferredContentMode: InAppWebViewUserPreferredContentMode.MOBILE,
    useShouldInterceptAjaxRequest: true,
    useShouldInterceptFetchRequest: true,
)
...
shouldInterceptAjaxRequest: (InAppWebViewController controller, AjaxRequest ajaxReq) async {
    print("ajaxReq.url: ${ajaxReq.url}");

    ajaxReq.headers.setRequestHeader("someheader", "somevalue");

    return ajaxReq;
},

@ariefaprilianto hello,how to fix

It's solved. Actually it just get blocked by CORS policy at the preflight.

Hi there,
Could you tell me how to fix this?


Chrome crashes when viewing large profiles

I tried using https://speedscope.app with a relatively large profile JSON file, which is around 65 MB in size.
While switching around between different threads it suddenly crashed.
I'm running Chrome Version 89.0.4389.114 (Official Build) (64-bit) on Ubuntu 20.04 with an Nvidia 1660 Ti and 32 GB RAM.
Is there a local / desktop viewer for the generated .json file from py-spy?
I used the command py-spy record -f speedscope  --subprocesses --pid 1234.

Did you find a workaround for this issue? I'm having the same problem

Hi! If either of you could provide a sample profile or a script which generates a sample profile that reproduces this, that would help me investigate.
It's possible the file is just too large, but I'd be surprised by that since there are other profile types that seem to load okay up to a couple hundred MB

I tried this on an instance of Odoo (https://github.com/odoo/odoo) running in Docker (https://hub.docker.com/_/odoo).
I generated the profile by running py-spy with the command I posted above and letting it run for a while (around 20 minutes).
But in general this should happen with any web-server or job queue application that constantly processes data.

Thanks for the high-level repro steps.
Being blunt, without a file to debug with or a script that I can copy paste and run to generate the file, I'm incredibly unlikely to invest any time to debug this.

Jamie, I appreciate your work on this project, but I don't see the need for sarcasm.
I also don't believe I was blunt as I tried to describe my profiling environment as clearly as possible.
As I stated, I cannot share my profile as it contains sensitive information.
May I ask if you have tested this tool on large profiles, perhaps multiple megabytes or even gigabytes of data?

Sorry, I wasn't intending to be sarcastic, but to be, as I said, blunt. I mean what I said literally.
From the instructions written, to investigate further, I believe I'd have to figure out what odoo is, figure out how to boot the docker image, figure out how to install py-spy, figure out how to find right pid for odoo, and then finally run the command that you've provided.
If you could provide a github repository which I can clone and run a single command to generate a file which creates the failure scenario, then that would create a much stronger incentive to investigate.
I have tested speedscope on multi-megabyte files in the past and it's worked, but each file format is different.
As an example of another issue (which I admittedly also have not taken the time to investigate yet) in which easy reproduction steps were provided, see https://github.com/jlfwong/speedscope/issues/340. When I do have time, using the steps specifically outlined in that issue, I'll be able to reproduce the issue focusing only on the portions that are relevant to speedscope's own source.

Thanks for the clarification.
I will try to repeat the same steps in a clean environment and post the profile.


Make content lists synchronous

We don't have to do an extra API call to get all the page data required for content lists, so they no longer have to be async 🎊
Fixes #4519

@davidpmccormick what about when we pull in things with formats?

Or any linked content?


[test] Migrate more components to react-testing-library #22872

Replaces enzyme for react-testing-library in the <HiddenJs/> and <HiddenCss/>

[x] I have followed (at least) the PR section of the contributing guide.

I don't know how to test these cases in <Hidden />
https://github.com/mui-org/material-ui/blob/b3d431a0ff1389c8924343925be753dff1b81600/packages/material-ui/src/Hidden/Hidden.test.js#L15-L23
Since we can't check which children type was rendered using react-testing-library   Could you give me a tip, please?


Instructions for connection as a simulator when developing

@tomdixon, if you're happy with this wording I'll add the same instructions to https://github.com/clockwork-dog/cogs-client-react-lib


Feature: Reading slack token from env flag

closes #21

so that's 0.3.0 (incompatible (yet necessary) change)

@ani1311  Aniket, you should be able to make a release, right ? (and autogenerate release notes, then the github action will add the binary build and push the docker images)

Ya, I can do the release. Making 0.3.0 now.


Fix git-for-windows repo url

Probably a copy paste error from https://github.com/git/git-scm.com/pull/944

"adding" @sxlijin as a reviewer since he was the one who created the template

Yes, I think this is an obvious improvement. I'll merge (but @sxlijin feel free to say so if you meant something different).


[BUG] org.opensearch.action.search.SearchResponseTests.testFromXContentWithUnregisteredSearchExtBuilders is flaky

Describe the bug
The following test cases are flaky:

org.opensearch.action.search.SearchResponseTests.testFromXContentWithUnregisteredSearchExtBuilders
org.opensearch.search.GenericSearchExtBuilderTests.testFromXContentWithUnregisteredSearchExtBuilders

Caused by: org.yaml.snakeyaml.error.YAMLException: The incoming YAML document exceeds the limit: 3145728 code points.
	at app//org.yaml.snakeyaml.scanner.ScannerImpl.fetchMoreTokens(ScannerImpl.java:317)
	at app//org.yaml.snakeyaml.scanner.ScannerImpl.checkToken(ScannerImpl.java:238)
	at app//org.yaml.snakeyaml.parser.ParserImpl$ParseBlockMappingKey.produce(ParserImpl.java:637)
	at app//org.yaml.snakeyaml.parser.ParserImpl.peekEvent(ParserImpl.java:161)
	at app//org.yaml.snakeyaml.parser.ParserImpl.getEvent(ParserImpl.java:170)
	at app//com.fasterxml.jackson.dataformat.yaml.YAMLParser.nextToken(YAMLParser.java:429)
	... 81 more

To Reproduce
It happens when the search response is too large for the YAML parser (3 MB limit).
./gradlew ':server:test' --tests "org.opensearch.action.search.SearchResponseTests.testFromXContentWithUnregisteredSearchExtBuilders" -Dtests.seed=F439DE99AECABF2F -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=id-ID -Dtests.timezone=America/Indiana/Knox -Druntime.java=21

./gradlew ':server:test' --tests "org.opensearch.search.GenericSearchExtBuilderTests.testFromXContentWithUnregisteredSearchExtBuilders" -Dtests.seed=F439DE99AECABF2F -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=ar-DZ -Dtests.timezone=Indian/Comoro -Druntime.java=21

Expected behavior
The tests should always pass
Plugins
Standard distribution
Screenshots
N/A
Host/Environment (please complete the following information)
CI (Jenkins)
Additional context
Failing build: https://build.ci.opensearch.org/job/gradle-check/30833/

Here's the output of the search response that failed to parse due to its very large size:
SearchResponse_testFromXContentWithUnregisteredSearchExtBuilders.json
This happens due to very deeply nested aggregations in the search response. Test aggregations are created recursively up to some maximum depth (here), which can lead to exponentially large payloads on rare occasions. We can lower the maximum depth from 5 to 4, which should help us not go past the 3 MB parsing limit for YAML.

Closing this issue since we haven't been seeing this test as flaky for a while and if it happens again then opensearch-ci-bot will open up the issue back automatically.


Move site config to toml

Hello @weibullguy! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file setup.py:

Line 2:80: E501 line too long (84 > 79 characters)

In the file src/ramstk/RAMSTK.py:

Line 76:80: E501 line too long (90 > 79 characters)
Line 79:80: E501 line too long (90 > 79 characters)
Line 269:80: E501 line too long (91 > 79 characters)
Line 271:80: E501 line too long (94 > 79 characters)


30651: eq should raise NotImplementedError for different instance type

@srinivasreddy Some tests are required. Moreover @ElizabethU is assigned to this ticket (see comment), you should at least try to ask her and reassign a ticket, because she can work on it.

@felixxm  Ah, Looks like I missed that.  @ElizabethU I am closing this PR since you got assigned. Let me know if you don't have the bandwidth or for some other reason to work on this.


Handle cases when github data isn't available

I got this error when trying out your cli:

It was because the github key didn't exist on the api response. This PR addresses the issue. Here's how it looks now:

Thanks for the PR :+1:
Please open issue first next time so that we can discuss the issue :)
Seems like there's a failing check, and some test has failed.
I will update you once I review your code.

Also please only git add  necessary files that you changed, this way we don't have to review extra files that get created on the go.
Avoid a git add . :)

when I tried to commit code, other files changed as well and I thought those were necessary. Are there any files that shouldn't have been committed?

You should only commit the files that you have made changes in.
Rest of the code looks good to me.
Merging and Closing PR :)

Seems like you didn't use npm run commit
Please read the CONTRIBUTING.md it has all the instructions.
Anyways merging.


Blog falco 0.24

What type of PR is this?
/kind content
Any specific area of the project related to this PR?
/area blog
What this PR does / why we need it:
Falco 0.24 has been released!
Which issue(s) this PR fixes:
NONE
Special notes for your reviewer:

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To complete the pull request process, please assign leodido
You can assign the PR to them by writing /assign @leodido in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

LGTM label has been added.  Git tree hash: 083463bd1592ab5d373e65fbc662b84473dd2b5e

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: fntlnz
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [fntlnz]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


[9.x] Share logging context across channels and stacks

Purpose
This PR bring the ability to share context across all channels and stacks, rather than just one.
Why this feature is useful
Currently when we specify context, it is on a per log or per channel basis.
// per log...

Log::info('per log', ['log' => 'context']);

// per channel...

Log::withContext(['channel' => 'context']);

Log::channel('stderr')->withContext(['channel' => 'context']);

but there is no way to specify context to be shared across all channels and stacks.
This feature is useful in the example currently shown in the docs for the withContext feature of a channel.
The example in the docs being...
class AssignRequestId
{
    /**
     * Handle an incoming request.
     *
     * @param  \Illuminate\Http\Request  $request
     * @param  \Closure  $next
     * @return mixed
     */
    public function handle($request, Closure $next)
    {
        $requestId = (string) Str::uuid();

        Log::withContext([
            'request-id' => $requestId
        ]);

        return $next($request)->header('Request-Id', $requestId);
    }
}

The problem with this is that it only applies the context the the default channel, but it would be useful if the context was shared across ALL channels and stacks.
Usage
This new feature could be used in a middleware as above, but also in a service provider to apply a unique ID to all invocations of the app, be it from a request or a job or an artisan command.
class AppServiceProvider
{
    public function register()
    {
        //
    }

    public function boot()
    {
        Log::shareContext([
            'invocation-id' => Str::uuid(),
        ]);
    }
}

Now in my application, no matter what logger I use, I'll have the invocation ID in my context.
Log::info(/* ... */);

Log::channel('stderr')->info(/* ... */);

Log::channel('bugsnag')->info(/* ... */);

Other logging systems outside of the Laravel logging system can also hook in and get the shared context to utilise...
$sharedContext = Log::sharedContext();

Notes

Not doing anything to the emergency logger. One I couldn't test it, and two if there is something funky happening with the context that is causing the initial logger to fail creation I wouldn't want that to also apply to the emergency logger.
Stacks get the shared context at the time they are created, but do not get any additional shared context once resolved - where as channels will always have the latest shared context.
Merging is performed in the same manner as withContext i.e. not recursive.

How can we reset this behavior?
How does it work with Octane?

Regarding Octane, you would need to hook into events...
$this->app['events']->listen([
    RequestReceived::class,
    TaskReceived::class,
    TickReceived::class,
], fn () => Log::shareContext(['invocation-id' => (string) Str::uuid()]));

We could potentially add some magic into Octane to handle this for you or document it on the Octane documentation.

@taylorotwell see: https://github.com/laravel/octane/pull/513
note that the new test will fail until this PR is merged / tagged. I've tested locally and got the ✅

I just tested the sharedContext but the logs on my Job does not have the context.
Is this by design or there are other configuration needed?
PS: I tested this on Laravel 10.


Unify all cross-plataform headers in one

I don't plan at this moment full multiplatform.
I dropped idea of x86 dir, due to test dir.

I don't plan at this moment full multiplatform. I dropped idea of x86 dir, due to test dir.

Ok