PyPSA

Name
PyPSA
Screenshots

Focus Topic
Open source toolbox for simulating and optimising modern power and energy systems
Primary Purpose
Energy system planning software for least-cost scenarios
Description
Under the PyPSA toolbox one can find multiple tools with different goals:

PyPSA: Provide an open-source toolbox for simulating and optimising modern power and energy systems
PyPSA-Eur: Provide an open data workflow for planning European transmission systems
PyPSA-Eur-Sec: Provide an open data workflow for planning European multi-sector energy systems
Atlite: Calculating renewable power potentials and time series
Linopy: Make linear programming in python easy, highly-flexible and performant
Powerplantmatching: Combining power plant databases

Coordinated under the PyPSA meets Africa initiative:

PyPSA-Africa/Earth: Provide an open data workflow for planning Earth’s multi-sector energy systems from municipal to continental scale. (Release of prototype end of 2021)
Detect Energy: Detect energy assets from satellite imagines for creating new open data

Mathematical Description
sequential cost minimizing mixed integer linear program with economic objectives
Website
https://pypsa.org/
Documentation
https://pypsa.org/
Source
Accessible over https://pypsa.org/
Year
2017
Institution
Technical University Berlin, Karlsruhe Institute of Technology, University Gießen, Climate Analytics, Frankfurt Institute for Advanced Studies, Aarhus University, University of Edinburgh, University of Pisa, Frauenhofer, University of Trondheim, ...
Funding Source
Multiple
Publications
30+
Publication List
A list of publication is given here: https://pypsa.readthedocs.io/en/latest/users.html#universities-and-research-institutes
Use Cases
Multi-sector energy system planning tool. Based on least-cost investment and dispatch pathway optimisation in (optional) high temporal and spatial resolution. From mini-grid to large multi-continental scales - the user can decide what to investigate.
Example diagram of sector linkages (can be extended with more technologies/vectors):

Infrastructure Sector

[ ] Atmospheric dispersion
[X] Agriculture
[X] Biomass
[ ] Buildings
[ ] Communications
[X] Cooling
[ ] Ecosystems
[X] Electric
[X] District heating
[ ] Forestry
[ ] Health
[X] Hydrogen
[X] Individual heating
[ ] Land use
[ ] Liquid fuels
[ ] Natural Gas
[X] Transportation
[ ] Water

Represented Behavior

[ ] Earth Systems
[ ] Employment
[X] Built Infrastructure
[ ] Financial
[ ] Macro-economy
[ ] Micro-economy
[X] Policy
[ ] Social

Modeling Paradigm

[X] Analytics
[X] Data
[X] Discrete Simulation
[ ] Dynamic Simulation
[ ] Equilibrium
[ ] Engineering/Design
[X] Optimization
[X] Visualization

Capabilities
PyPSA can calculate:

static power flow (using both the full non-linear network equations and
the linearised network equations)
linear optimal power flow (least-cost optimisation of power plant
and storage dispatch within network constraints, using the linear
network equations, over several snapshots)
security-constrained linear optimal power flow
total electricity/energy system least-cost investment optimisation
(using linear network equations, over several snapshots
simultaneously for optimisation of generation and storage dispatch
and investment in the capacities of generation, storage,
transmission and other infrastructure)

It has models for:

meshed multiply-connected AC and DC networks, with controllable
converters between AC and DC networks
standard types for lines and transformers following the implementation in pandapower
conventional dispatchable generators with unit commitment
generators with time-varying power availability, such as
wind and solar generators
storage units with efficiency losses
simple hydroelectricity with inflow and spillage
coupling with other energy carriers
basic components out of which more complicated assets can be built,
such as Combined Heat and Power (CHP) units, heat pumps, resistive
Power-to-Heat (P2H), Power-to-Gas (P2G), battery electric vehicles
(BEVs), Fischer-Tropsch, direct air capture (DAC), etc.; each of
these is demonstrated in the examples

Programming Language

[ ] C – ISO/IEC 9899
[ ] C++ (C plus plus) – ISO/IEC 14882
[ ] C# (C sharp) – ISO/IEC 23270
[ ] Delphi
[ ] GAMS (General Algebraic Modeling System)
[ ] Go
[ ] Haskell
[ ] Java
[ ] JavaScript(Scripting language)
[ ] Julia
[ ] Kotlin
[ ] LabVIEW
[ ] Lua
[ ] MATLAB
[ ] Modelica
[ ] Nim
[ ] Object Pascal
[ ] Octave
[ ] Pascal Script
[X] Python
[ ] R
[ ] Rust
[ ] Simulink
[ ] Swift (Apple programming language)
[ ] WebAssembly
[ ] Zig

Required Dependencies
No response
What is the software tool's license?
MIT License (MIT)
Operating System Support

[X] Windows
[X] Mac OSX
[X] Linux
[ ] iOS
[ ] Android

User Interface

[X] Programmatic
[X] Command line
[ ] Web based
[ ] Graphical user
[ ] Menu driven
[ ] Form based
[ ] Natural language

Parallel Computing Paradigm

[X] Multi-threaded computing
[X] Multi-core computing
[ ] Distributed computing
[X] Cluster computing
[ ] Massively parallel computing
[ ] Grid computing
[ ] Reconfigurable computing with field-programmable gate arrays (FPGA)
[ ] General-purpose computing on graphics processing units
[ ] Application-specific integrated circuits
[ ] Vector processors

What is the highest temporal resolution supported by the tool?
Instant
What is the typical temporal resolution supported by the tool?
Hours
What is the largest temporal scope supported by the tool?

Decades
What is the highest spatial resolution supported by the tool?
Municipality
What is the typical spatial resolution supported by the tool?
County
What is the largest spatial scope supported by the tool?

Continent
Input Data Format
CSV, netCDF, HDF5, JSON, GeoJSON
Input Data Description
No response
Output Data Format
CSV, XML, GeoJSON, ...
Output Data Description
infrastructure sizes, cost, operation, emissions
Contact Details
<EMAIL_ADDRESS>Interface, Integration, and Linkage
No response

Thanks for filling out the template and submitting the tool!


Class 'PayButtonViewFactory' is not abstract and does not implement abstract base class

Hello,
I get this error when trying to build my flutter (flutter version 3.0.0) app for android:
Class 'PayButtonViewFactory' is not abstract and does not implement abstract base class member public abstract fun create(p0: Context?, p1: Int, p2: Any?): PlatformView defined in io.flutter.plugin.platform.PlatformViewFactory
e: /Users/gilles/Documents/Resources/flutter/.pub-cache/hosted/pub.dartlang.org/pay_android-1.0.11/android/src/main/kotlin/io/flutter/plugins/pay_android/view/PayButtonViewFactory.kt: (25, 5): 'create' overrides nothing

In pubspec I use pay: ^1.0.10
In build.gradle:
buildscript {
    ext.kotlin_version = '1.7.10'
    repositories {
        google()
        jcenter()
    }

    dependencies {
        classpath 'com.android.tools.build:gradle:7.2.2'
        classpath "org.jetbrains.kotlin:kotlin-gradle-plugin:$kotlin_version"
        classpath 'com.google.gms:google-services:4.3.5'
        classpath 'com.google.firebase:firebase-crashlytics-gradle:2.3.0'
    }
}

flutter doctor --verbose
[✓] Flutter (Channel stable, 3.0.0, on macOS 13.4.1 22F770820d darwin-x64, locale en-GB)
• Flutter version 3.0.0 at /Users/gilles/Documents/Resources/flutter
• Upstream repository https://github.com/flutter/flutter.git
• Framework revision ee4e09cce0 (1 year, 3 months ago), 2022-05-09 16:45:18 -0700
• Engine revision d1b9a6938a
• Dart version 2.17.0
• DevTools version 2.12.2
[✓] Android toolchain - develop for Android devices (Android SDK version 33.0.1)
• Android SDK at /Users/gilles/Library/Android/sdk
• Platform android-33, build-tools 33.0.1
• Java binary at: /Users/gilles/Documents/Resources/Contents-Java11/jre/Contents/Home/bin/java
• Java version OpenJDK Runtime Environment (build 11.0.13+0-b1751.21-8125866)
• All Android licenses accepted.
[✓] Xcode - develop for iOS and macOS (Xcode 14.3.1)
• Xcode at /Applications/Xcode.app/Contents/Developer
• CocoaPods version 1.12.1
[✓] Chrome - develop for the web
• Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome
[✓] Android Studio (version 2021.3)
• Android Studio at /Applications/Android Studio.app/Contents
• Flutter plugin can be installed from:
🔨 https://plugins.jetbrains.com/plugin/9212-flutter
• Dart plugin can be installed from:
🔨 https://plugins.jetbrains.com/plugin/6351-dart
• Java version OpenJDK Runtime Environment (build 11.0.13+0-b1751.21-8125866)
[✓] VS Code (version 1.80.2)
• VS Code at /Applications/Visual Studio Code.app/Contents
• Flutter extension version 3.70.0
[✓] Connected device (3 available)
• sdk gphone x86 (mobile) • emulator-5554 • android-x86    • Android 11 (API 30) (emulator)
• macOS (desktop)         • macos         • darwin-x64     • macOS 13.4.1 22F770820d darwin-x64
• Chrome (web)            • chrome        • web-javascript • Google Chrome 115.0.5790.114
[✓] HTTP Host Availability
• All required HTTP hosts are available
• No issues found!
Thanks for your help

Hi @assurancetourix! Does that sample app build?

Closing due to inactivity, feel free to reopen if the problem persists.


We need to figure out what's different in restic restores of this e2e app in CI on 4.12 vs. 4.11 (and what's different with restic vs. the working CSI case).

Since https://github.com/openshift/oadp-operator/pull/1113 merged with pending discussion.

There is a new podSecurity admissions that were recently introduced.
https://access.redhat.com/solutions/7002730
Detailed background information:
https://start.learning.redhat.com/totara/4706
https://github.com/redhat-openshift-ecosystem/community-operators-prod/discussions/1417
There have been multiple scenarios where users had to tweak the labels to get rid of PSA related issues.
Unable to label custom namespaces with pod security admission annotations
Pod Security Admission alert firing and preventing upgrade from completing
RHOCP4 projects are getting warn and audit pod security admission label as baseline profile instead of restricted


Missing license

Hi!
great blog article. Can you maybe add a license so it's safe to work with the code?
Best regards!

@JannikStreek sure. Thanks for noticing it.
@megabotan could you please take a look?

that would be great thanks! MIT would be nice (and I think that's the intention with the blog) but the choice is obviously up to you :)


Newer versions of Amplify CLI not creating the IAM policy properly for DynamoDB datasource

How did you install the Amplify CLI?
npm
If applicable, what version of Node.js are you using?
Node v20.11.1
Amplify CLI Version
Amplify v12.12.6
What operating system are you using?
Mac
Did you make any manual changes to the cloud resources managed by Amplify? Please describe the changes made.
NA
Describe the bug
Amplify CLI v12.12.6 is not generating the correct IAM permissions policy in case of overrides being defined for DynamoDB datasource. This results in IAM AccessDenied Error when the DynamoDB datasource is accessed via the AppSync API. Refer to the below replication steps.
Testing with previous version of Amplify CLI (v12.10.1), the correct permissions policy is being generated for the changed name and associated with the role.
Additionally, the newer versions pops up warning about the usage of iam in @auth and requires us to change this to identityPool, however, the documentation is not updated and still suggests to use iam.
Expected behavior
The correct permissions policies should be generated and associated with the role.
Reproduction steps

In Amplify Gen1 application, add the GraphQL API with IAM authorization using Amplify CLI v12.12.6.
Run amplify override api.
Define the following override in override.js to change the table name of the DynamoDB table as below:

resources.models["Todo"].modelDDBTable.tableName = `Todo-dev`;

Push the changes and check the IAM role associated with the AppSync API under datasource section.
The role would not have permissions for the changed DynamoDB table name. Role would only contain the policy named DynamoDBAccess, which has inline permissions for only the auto-generated table name and not the override one. This results in AccessDenied error.

Project Identifier
No response
Log output

# Put your logs below this line

Additional information
No response
Before submitting, please confirm:

[X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
[X] I have removed any sensitive information from my code snippets and submission.

Any idea when (version) this bug was introduced?

Hi @call2shadab, Thanks for bringing this up. Could you try rolling back to version v12.12.3 and let me know if it resolves the issue?

Hey 👋 , This issue is being closed due to inactivity. If you are still experiencing the same problem and need further assistance, please feel free to leave a comment. This will enable us to reopen the issue and provide you with the necessary support.


Git Sync

Ability to save request information to the Git repo so users can share configuration.

Interesting...
I don't quite get the whole idea since the extension already saves user request information in their local machine.
Want to enlighten me?

Sounds interesting, this would give this extension an edge over thunderclient, as thunder client doesn't offer this and I have suffered due to lack of a feature like this in a hackathon.

If anybody's willing to implement this feature, feel free to do so! It does sound like a cool feature to add

I would love to give it a try, I'll keep you updated! Assign it to me if sounds fair.

must have feature +1

I have been wishing there was a VS Code REST client that could easily sync to git for years. This would be a very useful feature

Just found out about Bruno, going to give it a try. They also have a VSCode extension.
https://www.usebruno.com/
https://marketplace.visualstudio.com/items?itemName=bruno-api-client.bruno

@unwls I'll try implementing this, if it's still not done

Proposal

Will make user get their developer access token for personal use from Github
Will use this token to create a separate repo for saving data of this extension
Their will be different directories in this repo for each project in which our extension is being used
It will auto save data when user makes a requests using this extension and will also auto save data whenever users exits or closes the extension

In short, user won't ever need to press a save button or anything like that, everything will be done automatically.
Let me know if you think anything should be done differently!

No, just save the files local to the repo. The plugin needs to be able to read and update these files

@akash1520 PR's are always welcome 👍🏻


IronRuby has been a dead project for 10 years

Iron Ruby was abandoned as a project by Microsoft in spring of 2011.  It only supports Ruby 1.8.6 and I am wondering if rake-compiler will even load on that last release.  Time to remove this warning saying they do not support native c-exts?

Good catch!

Good catch!


Add OpenSea created tokens and initial schema for sub-communities

DB schema changes
parent_id is added to contracts to refer to the parent contract of a contract, if applicable. Child contracts are inserted into the contracts table with reference to the parent_id. The address column for child contracts is a unique identifier that uniquely identifies the child contract within the parent contract. For Opensea, this is the "slug" of the collection, but it will differ per contract.
child_contract_id is added to tokens to refer to the child contract that a token may also belong to. I figure that a token can only belong to one sub-contract at most. Resolvers figure out which tokens to fetch based on a flag, is_root_node, which is determined by checking if the community being resolved has a parent node. If it is a parent node, queries will fetch tokens matching the contract column, and use child_contract_id otherwise.
I didn't find any issues with using a non-ethereum address as the value for the address column in my testing, but will definitely keep testing / keep an eye on this.
GraphQL schema changes
# New fields

type GalleryUser {
  createdCommunities(
    input: CreatedCommunitiesInput!
    before: String
    after: String
    first: Int
    last: Int
  ): CommunitiesConnection @goField(forceResolver: true)
}

type Community {
  creator: GalleryUser @goField(forceResolver: true)
  parentCommunity: CommunityEdge @goField(forceResolver: true)
  subCommunities(before: String, after: String, first: Int, last: Int): CommunitiesConnection
    @goField(forceResolver: true)
}

type Mutation {
  syncCreatedTokens(input: SyncCreatedTokensInput!): SyncCreatedTokensPayloadOrError @authRequired
}

Multichain changes
childContractFetcher is the new provider interface for fetching child contract-related data. The runtime validation was also improved to provide more human-readable errors on failing. Helper methods were also added to help fetch matching providers per chain.
OpenSea changes
Previously, all assets needed to be fetched from OpenSea before any processing was done on them. Now, assets are processed as they are received which should help performance.
A new method, GetChildContractsCreatedOnSharedContract, is also added to support fetching child contracts from OpenSea shared contracts. An important thing to note is that the owner of tokens fetched via this method is the user (i.e. the "creator", even if they don't actually own the token). This is subject to change depending on how artist tokens are implemented.
TODOs
This PR doesn't handle artist tokens or processing artist tokens after they are synced.
Misc changes

Updates contract bulk upsert to use arrays
Removes old queries and dataloaders that are no longer used
Removes deep refresh stuff

TODO: Add child contract address to communityByAddress query


how to create mask.png?

hi, how can i change the mask location used in blend,lua?
ex: i want to make the square mask to mask the top left of the image instead of the center?
can u help

Same question here. Thanks for author's help

I created it manually. But the context encoder can only inpaints the center of the image. I would suggest move the top left of the image to the center (by padding).

thanks alot


Update .gitattributes

I'd suggest making those changes to your .gitattributes file.
This will ensure that if you upload vba code to GitHub and people try to download the raw file, they won't have issue when they try to import the file inside the VB editor.

The reason why this is an issue is because the VB Editor can't deal with LF (Unix-style line endings) and expect the file to use CRLF (Windows-style line endings).

Ah, so that's why people had issues when they downloaded and tried to import it. Thank you so much for your help; I wasn't aware of that ! So, I should be able to put my raw files inside my repo now, right ?

Btw, I finally made public a repo that I was wokring on about optimal configurations for a VBA project on GitHub. He'res the link in case you'd like to check it out for more details:
https://github.com/DecimalTurn/VBA-on-GitHub

Hey,
I just took a look at your VBA project template and wanted to say it's really good. It helped me a lot to understand the issues with VBA on GitHub and provided valuable context on why they exist. I might use some of your template for my .gitignore and other configurations next time I commit !
Thanks again !


Set Dependabot

To automate package updates it is good to use Dependabot

Closing this issue as decided that Dependabot is not needed.


Initial parser for COVID19-India API data

Some notes:

Sorry for the large diff!
As stated, this isn't parsing every field. It's parsing most fields, and everything we show in the UI --  this is probably a decent stopping point until we finalize the case schema/API.
Not adding the function to the SAM template; will do that subsequently. Doing separately since I'll have to tweak a couple things in the retrieval function when I do this, and there's already enough going on in this PR.

 S#4: Write/deploy a parser Lambda to operate on the example source data


Schema (size) is limited by underlying meta store data type

Using MySQL db for SR, customer is attempting to register a schema > 65,000 characters. The schema_version_info table stores the schema in the schemaText field which is set to TEXT data type and we were getting truncation errors attempting to register such a large schema. Ran the following alter table to increase the size: ALTER TABLE schema_version_info MODIFY schemaText MEDIUMTEXT;

Would it be best to maybe even store it as a CLOB or BLOB

https://github.com/hortonworks/registry/pull/314


Implement functionality to work with slurm partitions queues #19

Implement functionality to work with Slurm partitions(queues) #19
Functionality to manipulate partitions in slurm was added:
1.listing of partitions with filter and without it
2.partition creation
3.update of existing partition
4.deletion of partition

maybe we could add some tests?


Add support for strstr() builtin

I have a requirement, I hope to be able to check which process deleted the "cores" related files.
First of all, because my need is to write a script that is deployed on thousands of servers, it is difficult for us to confirm its configuration and the directory it is mounted on because of the change of the deployment version, so we need fuzzy matching.
The only existing str function that supports bpftrace is strncmp, which has no way to obfuscate. And there is no way to traverse strings in bpftrace, so there is no way to use strncmp to write a strstr by hand.
Describe the solution you'd like

Solution 1: Add a new built-in func like strstr()
 bpftrace  -e 'tracepoint:syscalls:sys_enter_unlink / strstr( str(args->pathname), "cores") > 0 / {printf("comm: %s(%d) delete file: %s\n", comm, pid, str(args->pathname)); printf("%s\n", ustack());}'
I think strstr this is a generic requirement. There may be many times when there is no way to confirm the absolute path of the file or the full name of the process or...
Describe alternative solutions or features you've considered

Another way is to get all the information in kernel mode and then filter it in user mode. But this results in a lot of pointless copying from kernel mode to user mode. I have tested that attaching the bpftrace program to the specified function and frequently triggering it. Copying all the information to user mode will cause a CPU to reach 100% utilization. Copying after kernel-state filtering has almost no impact on performance.
I'm willing to submit a PR about this. Please leave comments if any, thanks!

It could be nice to have strstr and since the BPF verifier now allows bounded loops and we have strings of bounded size, it should be possible to implement it. The implementation may still be tricky, but feel free to give it a try.

I have started to develop this function now, but I have not developed bpftrace before, and I am not familiar with the related libraries of llvm. I have some difficulties in development and debugging. Do you have relevant information here to help me get started quickly?

I am currently developing based on  0.12.1_release version, is this branch ok? If not, is it a recommended branch?

All development happens against the master branch. 0.12 is quite an old release.
As for LLVM, its something you have to get your head around. I recommend taking a look at the basics of single static assignment (SSA) and then at the IR reference guide and checking how other parts are implemented. The implementation of strncmp might be a good starting point: https://github.com/iovisor/bpftrace/blob/14ec7eaf32e3fa3818497a8a6361a77bb5c49189/src/ast/irbuilderbpf.cpp#L735

This branch( 0.12.1_release) is used because there was a problem compiling the master. https://github.com/iovisor/bpftrace/issues/1610

0.12 is 1.5y old by now. Any work you do you'd have to rebase against master and that will be a massive challenge. Please make sure you have an up to date bcc and libbpf. You might have to compile those your self as debian 10 is fairly old

Ok, I will update my developer computer to debian11 and rebuild the development environment. Thanks for your reply

Completed via #2393.


Rename ThemeData to FlutentThemeData

Is your feature request related to a problem? Please describe.
flutent_ui ThemeData conflicts with flutter ThemeData class
Describe the solution you'd like
Rename fluent_ui ThemeData to FluentThemeData
Describe alternatives you've considered
importing as but it is uncomfortable
Additional context
no

A sudden change like this is not dev-friendly. In the mentioned PR, ThemeData is depreacted and should be removed sometime in the future


expose request path to runOn commands as an environment variable

This patch modifies the runOnInit/runOnDemand/runOnPublish/runOnRead callers to set an environment variable with the calling path. (For runOnInit, it will be called with the configured path, of course)
A pathEnvVariable configuration item is also introduced to specify the name of the environment variable to be used. Its default value is RTSP_SERVER_PATH and there is sanity checking to ensure that the provided name is valid (alphanumeric + underscore, no leading digit).
(Addresses #47)

merged, thanks, but i'll remove the PathEnvVariable option since 99.99% of users won't need it.


Trying to get in touch regarding a security issue

Hey there!
I'd like to report a security issue but cannot find contact instructions on your repository.
If not a hassle, might you kindly add a SECURITY.md file with an email, or another contact method? GitHub recommends this best practice to ensure security issues are responsibly disclosed, and it would serve as a simple instruction for security researchers in the future.
Thank you for your consideration, and I look forward to hearing from you!
(cc @huntr-helper)

Thank you @JamieSlome - were already rolling out SECURITY files to our modules, we will get one in here soon!
The security email address is not routing correctly right now. Please email @lonnieezell directly at<EMAIL_ADDRESS>I will let him know you will be in touch.


502 bad gateway on staging

The error occurs when accessing the chant-search from the navigation bar, where no parameters are given in the GET request. It should display a paginated list of all chants and sequences. It works on local, but throws 502 error on staging.

Chant search works now. The 502 error is gone although I didn't change anything in the code. It's probably some issue with CC servers.


Use Puppet[:confdir] instead of static path

This should make it work with Puppet 4, PE, etc.

+1


Update Rosetta code's examples

I wrote the existing Rosetta code examples a while back. I'm quite certain that most of them won't work in the current version of Lily. Given that there aren't many of them, it would be a relatively easy task to go through and update them to work in the current version. Most of the breakage is probably titlecasing built-in types, changing how returns are denoted, and adding interpolation. Given that there's a small number of easy examples ( < 100 lines total, between less than 20 examples), this wouldn't be that difficult. This would help the language by making sure that non-working examples are not someone's first introduction to the language.

@jesserayadkins I cant find any link to this, could you provide them for me?

Oh, sorry about that. The examples can be found here: http://rosettacode.org/wiki/Category:Lily

@jesserayadkins :+1:  wondering if you will be hanging at gitter, maybe to chat abit about lily( I am enjoying ipalyning with lily so far)

Closing this since I've just now finished touching up the examples that I put in.


Class 'CreateItemMetaTable' not found on migrate:rollback

I created an Unique Meta Model and Table for my Items model.
I can migrate the models with no problem but when I try to migrate:rollback / migrate:reset I get the next error:
Class 'CreateItemMetaTable' not found.
It ain't fixed with composer dump-autoload, any idea how to fix this?

I'll look into this. May I assume that the table was item_meta?

I was only able to partially reproduce the bug. I also got a class not found error. But after I ran composer dump-autoload and then php artisan migrate:rollback it worked without any error. I've triple checked the migration file and its identical to the factory ones.
Could you tell me what version of Laravel you are using, and if you have made any modifications to the standard directory structure (like moved migrations out of /database/)?
As a temporary work-around, you can add that class specifically to your autoloader in composer.json:
"autoload": {
        "files": ["database/migrations/file_name_here.php"]
    }

but this really isn't a long term solution.

Thnx I will check out if this removes the error tonight.
I use standard out of the box laravel5
Installed on a windows machine with XAMPP

After I put the file in in the autoload array in composer.json it ran.
Now I commented it out for testing and it does migrate / migrate:refresh like normal. Seems like issue is fixed, tough I don't really understand why ;) But thanks for the help!

You got it.
On Thu, Mar 26, 2015 at 1:53 PM, ray1618<EMAIL_ADDRESS>wrote:

After I put the file in in the autoload array in composer.json it ran.
Now I commented it out for testing and it does migrate / migrate:refresh
like normal. Seems like issue is fixed, tough I don't really understand why
;) But thanks for the help!
—
Reply to this email directly or view it on GitHub
https://github.com/phoenix-labs/eloquent-meta/issues/14#issuecomment-86668694
.


Minor refactor

@dclaux,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot


DateDisplay styling

Some more changes needed following the current design specs:

[ ] Add the date icon to the icon font, after #518
[ ] Replace MaterialIcon with the above icon, size 13x13

I can make a pr for this


Optional addition to #5658, simplifies the voucher generation

As mentioned in #5658, this pull request additionally simplifies the voucher generation.

@oittaa thanks, looks good!


Support spelling in "replace" command using talon alphabet

Something like "replace air with spell harp each look look odd"

@pokey Can be close this one?

See #58 for explanation of why we don't need this one anymore


Unable to disable/enable presets

I'm able to create a new preset template and adjust everything, but the slider/hotkey refuse to actually enable/disable plugins. I've tried using it with plugins that are shown to work in the general features examples, using only the slider without a hotkey yet assigned, storing them via cloud rather than local, and focus/unfocused. I am able to see the preset stored locally and the settings within the json. None have had any effect. When the preset is added and set at the default on position, it also does not change the state of a plugin that was already set to as off.

Iirc you are wondering that it should disable/enable the plugins you have included in the preset when turning the switch off/on.
Clicking the orange switch does nothing at the moment. It's intentional because you need to have presets that have different configurations to same plugin and then you can switch between the presets to change the plugins state.
So I believe in your case you have made presets and included some plugins to them but you don't have any changes in you plugin configurations to see the presets enable/disable switch to change.
When you click the orange icon, it copies the presets plugin configurations to your current configurations and when the preset contains same configurations that you have currently on, loading the preset does nothing.

Iirc you are wondering that it should disable/enable the plugins you have included in the preset when turning the switch off/on.
Clicking the orange switch does nothing at the moment. It's intentional because you need to have presets that have different configurations to same plugin and then you can switch between the presets to change the plugins state.
So I believe in your case you have made presets and included some plugins to them but you don't have any changes in you plugin configurations to see the presets enable/disable switch to change.
When you click the orange icon, it copies the presets plugin configurations to your current configurations and when the preset contains same configurations that you have currently on, loading the preset does nothing.

Great analysis.  Thanks!

Actually I have been thinking of it being a toggle also (maybe with a setting to make a preset work as "toggler"). That way you could make a preset and then include some plugins to it and then when you load the preset it loads the configs from the preset and when you "disable" the preset, it would toggle every included on/off accordingly.


keeps closing?

Ubuntu just randomly stops working

This is because youre using android 12 or higher. This is called Phantom Proccess. Please reffer to this article to fix your issue.
Disable Phantom Proccess Killing


How to get coordinates

Is there any other way or inbuilt feature to get the Pitch and yaw onClick ???

This is supported in the development version:
viewer = pannellum.viewer(...);
viewer.on('mousedown', function(event) {
    // For pitch and yaw of center of viewer
    console.log(viewer.getPitch(), viewer.getYaw());
    // For pitch and yaw of mouse location
    console.log(viewer.mouseEventToCoords(event));
});

I tried on the hotspot example but couldn't get the above to work,I'm pretty green when it comes to jScript,if it isnt much of a trouble,can you please show me how to store the pannellum.viewer(..) reference and then add the event listener ??

Hot spots

As I said previously, you need to use the development version, not the release version as you're doing.

Unable to build

I see that you're building this on Windows, maybe this will help...
On Windows 10, it's sufficient to download Python3 from here . Make sure python is in your PATH. I renamed python.exe to python3.exe (and also edited the very simple build.bat script) since I also have python 2.7 installed, but you could simply change the PATH order.
Download git for Windows here.
In a DOS window, do the same git clone as in Linux.
C:\Development> git clone https://github.com/mpetroff/pannellum.git
C:\Development> cd pannellum
C:\Development> cd utils\build
C:\Development> build
C:\Development> cd ..\..\build

Copy the files in this new build directory to your server. On Windows, I use either FileZilla or the NppFTP plugin within Notepad++.
I use Linux to make my multires tiles, but you can download the Hugin tools for Windows, here.

@MmmDee : Can't I use the Pannellum.js file in the src directory directly ??
Also,I'm just trying to accomplish to get the mouse coords(yaw and pitch ) and store them in a variable but since I'm pretty new to jscript,I'm unable to use the functions in the Pannellum.js file in my own html file.

TypeError: viewer.on is not a function;
I always get this error

As Matthew noted, you have to use the development branch.

After you copy the development branch in the fashion I noted above, build it on your system (Windows or Linux).

Then copy the resulting built files onto your server (assuming you have one).

Refer to your copy of the files on your server to "include" them into your webpage. (I'll add an example when I get on another computer.) You really don't want to modify and use the pannellum.js file directly in the fashion I think you're trying.

I downloaded it from the master branch and then I copied the .css and .js from the src into a proj folder in my wamp directory.
Specs:
Python 3.5.2
Wamp 3.0.4
Windows Server 2012

Thanks @MmmDee ,But how to add a mouse click event or mousedown event in my webpage that will call the mousecoords function inside pannellum.js and give me the return value,so that I can manipulate it.
I tried adding a listner to just the div that holds the pannellum.viewer and call the mousecoords function but I always get "not defined" or function doesnt exist,aslo tried the approach suggested by matthew,
viewer = pannellum.viewer(...);
viewer.on('mousedown', function(event) {
// For pitch and yaw of center of viewer
console.log(viewer.getPitch(), viewer.getYaw());
// For pitch and yaw of mouse location
console.log(viewer.mouseEventToCoords(event));
});
But then the console show's me that viewer.on isnt a function
Please help!!!

I suppose you can copy the two js files (pannellum.js and libpannellum.js) and 1 css file (pannellum.css) from the repository directly into the appropriate directories else where, but you'll also need the 5 image files (*.svg) from the css/img directory too and place that under your local/moved css directory.

Here's an example...
<!DOCTYPE HTML>

    <meta charset="utf-8">
    <meta name="viewport" content="width=device-width, initial-scale=1.0">
    <title>Event Test</title>

    <link rel="stylesheet" href="http://mysite.net/pannellumSRC/css/pannellum.css">

I still get that viewer1.on isn't a function,I just can't seem to fathom what I'm doing wrong
TypeError: viewer.on is not a function

Assuming there's not a typo in your html source file, then it it's likely something particular to your server setup and the way you're copying the pannellum files to it.  Is your html file short enough to post here, or provide a link to it?

I changed the example above to use the mousedown event. I confirmed it worked with the latest commit.

@MmmDee Thanks,I'm away from my console but I'm going to try this first thing come monday and let you know how it goes.Also,can you guide me to some online resource where I can learn and master Jscript and learn more about server-client interactions and best practices,I want to write some awesome web apps and thank you once again for your guidance and assist


Can run from fresh install

When I run commands from a fresh install, an error pops up

The bug has been fixed at version 2.2.0


Listing captions don't work in PDF generation

If I use the :listing-caption: setting, all my listings will have the appropriate caption in the preview window. However, the generated PDF will not have the captions. The :figure-caption: setting works in both preview and PDF. I could not find anything in the conf/docbook/fo folder to fix this issue.

Hi @dmetzgar , I'm actually not sure what these attributes are doing. First, Could you please give me some screenshots or examples to understand the issue?
Thank you.

Take the following example: AsciiDoc figure and listing captions
In the preview output, you will see captions under the figure and listing as "Figure 1.1. Duke's Choice Award Winner" and "Listing 1.1. Some script" respectively.
In the PDF output, the captions are "Figure 1. Duke's Choice Award Winner" and "Some script."
Basically the :*-caption: attributes are being ignored in the PDF generation. This wouldn't be too much of an issue for me except that listings are not numbered while figures and tables are.

Hi @dmetzgar, it could be changed in Docbook configuration files. Because, if you convert your Asciidoc file to Docbook, you will see nothing about captions;
<?xml version="1.0" encoding="UTF-8"?><?asciidoc-toc?>
<?asciidoc-numbered?>
<article xmlns="http://docbook.org/ns/docbook" xmlns:xlink="http://www.w3.org/1999/xlink" version="5.0" xml:lang="en">
<info>
<title>Introduction</title>
<date>2016-11-17</date>
</info>
<section xml:id="_introduction">
<title>Introduction</title>
<simpara>See <xref linkend="DukesChoice"/> and <xref linkend="MyScript"/>.</simpara>
<figure xml:id="DukesChoice">
<title>Duke’s Choice Award Winner</title>
<mediaobject>
<imageobject>
<imagedata align="center" fileref="images/duke.png"/>
</imageobject>
<textobject><phrase>duke.png</phrase></textobject>
</mediaobject>
</figure>
<formalpara xml:id="MyScript">
<title>Some script</title>
<para>
<screen>mkdir MyDirectory</screen>
</para>
</formalpara>
</section>
</article>

The issue here is that Asciidoctor converts listings to a  inside a  by default, which is not what you would expect.
https://github.com/asciidoctor/asciidoctor/issues/1441
You would expect the listing to be inside something like an  rather than a . Unfortunately AsciiDoc has more types of code blocks than DocBook, so  is already used by AsciiDoc's example block.
When working with Asciidoctor directly, you can reconfigure it to map listings to  or whatever elements you want, but I don't see a way to do that in AsciidocFX. So the remaining option is to configure the  output.
There are internationalization templates in docbook/common/ but for whatever reason, editing the formalpara template in docbook/common/en.xml seems to have no effect on the caption. (It works for figures, sections, etc, but not formalpara).
That seems to leave docbook-config/fo-pdf.xsl as perhaps the best place to configure the listing captions. You can edit the formalpara title there, but I haven't figured out the code to get a listing number in there.
http://www.sagehill.net/docbookxsl/FormalTitles.html#FormalNumbering

Here's what I have. In docbook-config/fo-pdf.xsl, find this template (starts around line 940):
<xsl:template match="db:formalpara/db:title | formalpara/title">
Replace the template with this:
<xsl:template match="db:formalpara/db:title | formalpara/title">
    <xsl:variable name="titleStr">
        <xsl:apply-templates/>
    </xsl:variable>

    <xsl:variable name="label">
        <xsl:apply-templates select="." mode="label.markup"/>
    </xsl:variable>

    <xsl:variable name="pchap"
        select="(ancestor::chapter
        |ancestor::appendix
        |ancestor::article[ancestor::book])[last()]"/>

    <xsl:variable name="prefix">
        <xsl:if test="count($pchap) > 0">
            <xsl:apply-templates select="$pchap" mode="label.markup"/>
        </xsl:if>
    </xsl:variable>

    <fo:block font-weight="bold" color="{$caption.color}">
        <xsl:text>Listing </xsl:text>
        <xsl:choose>
            <xsl:when test="@label">
                <xsl:value-of select="@label"/>
            </xsl:when>
            <xsl:otherwise>
                <xsl:choose>
                    <xsl:when test="$prefix != ''">
                        <xsl:apply-templates select="$pchap" mode="label.markup"/>
                        <xsl:apply-templates select="$pchap" mode="intralabel.punctuation">
                            <xsl:with-param name="object" select="."/>
                        </xsl:apply-templates>
                        <xsl:number format="1" count="formalpara/title"  from="chapter|appendix" level="any"/>
                    </xsl:when>
                    <xsl:otherwise>
                        <xsl:number format="1" count="formalpara/title" from="book|article" level="any"/>
                    </xsl:otherwise>
                </xsl:choose>
            </xsl:otherwise>
        </xsl:choose>
        <xsl:text>. </xsl:text>
        <xsl:copy-of select="$titleStr"/>
    </fo:block>

</xsl:template>

A couple notes:

If your doctype is set to book, this will include the chapter number in the listing number. If you don't want that, you could remove all the pchap and prefix stuff.
As this hijacks the formalpara title and adds a listing number to it, you effectively can't use formalparas as they were originally intended (because they will also have listing numbers). This isn't a problem for my case but if it is for you, you could probably add some logic to ensure that only actual listings get listing numbers.


Update http-error-405-website.md

@RyanLiu99 : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@HaiyingYu : Thanks for your contribution! The author(s) have been notified to review your proposed change.


Implement jagged argsort and speed up argminmax

At first, I enabled the 'staircase' method for argminmax in 322ad114e359b50c3663f7ffa016d5991fb02156, but realized it was susceptible to precision issues, e.g. the following code would produce incorrect output (should be all 1s):
import numpy as np, awkward
n = 10
a = awkward.JaggedArray.fromcounts(np.full(n, 2), np.tile(np.array([2**40, 2**40 + 2**-12]), n))
a.argmax().tolist()

It turns out that for large enough arrays, a.localindex[a.max() == a] is actually about as performant as the staircase method.
Then, using these argmax in a basic N^2 sort routine, one can get 'reasonable' performance for argsort, e.g.
n = 100000
mu = 3
counts = np.random.poisson(mu, size=n)
content = np.random.normal(size=counts.sum())
a = awkward.JaggedArray.fromcounts(counts, content)
%timeit a.argsort()
%timeit a.copy(content=np.argsort(a.content + a.content.max()*a.parents) - a.starts[a.parents])

produces
313 ms ± 11.6 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)
9.45 ms ± 306 µs per loop (mean ± std. dev. of 7 runs, 100 loops each)

so only 30x slower.  There is room for more micro-optimization in the implementation.

a.localindex[a.max() == a]

Isn't it possible for two elements to have the same maximum? What happens then?

In the case of argmax, take the first (as before) and for sort, it acts stably

It's a mask—doesn't it select both? If it's testing elements of the inner arrays, it can't be a flat boolean array—it must be a jagged boolean array. (Although you can force it to take at most one with [:1]...)
Also, if you've tested it and I just can't do indexing in my head, that's fair, too.
Oh, one last thing—what about nan? That's not equal to itself.

For argmax, yes I take at most one, which is what the lines in https://github.com/scikit-hep/awkward-array/blob/db7933c0dac8c413ce3a3292763d3f14429110c9/awkward/array/jagged.py#L1528-L1536 do.  The PR diff looks awful so you might not have seen that part.
For NaNs, already I observe that NaN does not propagate up from awkward reducers (bug?) so I decide to leave them alone for argminmax.  For sorting, I push them all to the end of the array (regardless of ascending/descending) with https://github.com/scikit-hep/awkward-array/blob/db7933c0dac8c413ce3a3292763d3f14429110c9/awkward/array/jagged.py#L1554

The policy that reducers take is to skip nans entirely, so they can never be the max or the min of an inner array. An array of all nan is as good as an empty array.
Note: the same is true of missing values due to MaskedArrays. A first order thing to think about is whether this breaks that behavior for reducers and argmax/argmin, which should have been recently tested in the homogeneity sweep, but not converted into automated tests yet. A second order thing to think about is what it would take to do the same for sort and argsort.
For sorting, users expect it to not change the length of the array, so they should be pushed to the end or something. (It could be the beginning or the end, but we like putting the most relevant values at the beginning, and nans are the least relevant.)
I'm on vacation and don't have easy access to look at the code right now. I could try it tomorrow morning (by running the tutorial I'm preparing for CoDaS-HEP before everybody wakes up).

Re: reducer policy - fine by me, but FYI
>>> np.max(np.array([5., 2., np.nan, 4.]))
nan
>>> np.min(np.array([5., 2., np.nan, 4.]))
nan

Re:

A first order thing to think about is whether this breaks that behavior for reducers and argmax/argmin, which should have been recently tested in the homogeneity sweep, but not converted into automated tests yet. A second order thing to think about is what it would take to do the same for sort and argsort.

So I would recommend adding unit tests as you check things.  Anyway, argmax() did not handle masked arrays correctly but now does:
>>> import awkward
>>> a = awkward.fromiter([[4., 2., None], [3., 5.], [None]])
>>> a.argmin()
<JaggedArray [[1] [0] []] at 0x00010da95c18>
>>> a.argmax()
<JaggedArray [[0] [1] []] at 0x00010ce8c630>

however the new argsort doesn't handle it.  Should a masked element disappear under argsort like it does under __getitem__ or should it go to the end of the array (after NaN, for example)?  For the first, the solution is easy, and for the second I think there is a solution but trying it uncovered another bug:
>>> ~(a.min()==a).fillna(True)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/ncsmith/src/awkward-array/awkward/array/base.py", line 719, in fillna
    return self.copy(content=self._util_fillna(self._content, value))
  File "/Users/ncsmith/src/awkward-array/awkward/array/base.py", line 634, in _util_fillna
    return array.fillna(value)
  File "/Users/ncsmith/src/awkward-array/awkward/array/masked.py", line 889, in fillna
    out[self.mask < 0] = value
IndexError: boolean index did not match indexed array along dimension 0; dimension is 4 but corresponding boolean dimension is 6

Fixes #81

It sounds like the first order is not only okay, but fixed by you, so thanks! The second order (have sorting deal with None) doesn't need to be done yet.

I put something in to at least not give undefined behavior: masked items are dropped from the resulting index list.  This means that a[a.argsort()] would produce a sorted output with the masked entries dropped.

I brought this PR up to date and bumped the version to prepare for a deployment. I've tested the merged version with uproot and the tutorial I'm writing—everything's good—so if these tests pass, I'll merge it.


Not starting on windows

Hi there!
I'd love to check the progress now and then, but I can't seem to get the program to run.
I've built with the following tools on a 64 bit win 10 machine:

(mingw) x86_64-12.2.0-release-posix-seh-msvcrt-rt_v10-rev2
cmake-3.26.0-rc3-windows-x86_64

During build I only see warnings, nothing seems to be obviously wrong.
Running embroidermodder.exe however gives no output at all and it simply does not start.
Am I missing something? Sorry if it's something obvious, I haven't used these build tools a lot.

Just found out there is a build on github now.
The latest (19 feb.) version fails to start the same way.
Is there some dependency I need to run it?

Tried on another machine with a relatively clean win 10, got the same results.

Just found out there was an error report in the reliability monitor:

Error
Source
embroidermodder.exe
Summary
Stopped working
Date
2/19/2023 3:52 PM
Status
Report sent
Description
Faulting Application Path:	D:\dev\Embroidermodder\build\embroidermodder.exe
Problem signature
Problem Event Name:	APPCRASH
Application Name:	embroidermodder.exe
Application Version:	<IP_ADDRESS>
Application Timestamp:	63f2366b
Fault Module Name:	libstdc++-6.dll
Fault Module Version:	<IP_ADDRESS>
Fault Module Timestamp:	6393bd76
Exception Code:	40000015
Exception Offset:<PHONE_NUMBER>022a46
OS Version:	10.0.19<IP_ADDRESS>.256.48
Locale ID:	1033
Additional Information 1:	2168
Additional Information 2:	216812ada14a7a72bf194afe3de15c0a
Additional Information 3:	edb9
Additional Information 4:	edb969eac7443283299b7c432b9ce336
Extra information about the problem
Bucket ID:	d3427cb64a988731da5b3689bd4f60fd<PHONE_NUMBER>081311485)

So this was currently a packaging error on my part: the assets directory wasn't copying right on windows.
If you either boot using test.bat or wait for the "daily" build I'm working on to update it should work.
Cheers,
Robin

This is fixed as of the current alpha build.
If you have any more problems, please open a new issue.


Error when using function ST_TRANSFORM

When trying to reprojecting coordinates into difference projection using ST_TRANSFORM like that:
SELECT name, X(transform(geometry,4326)) AS long, Y(transform(geometry,4326)) AS lat FROM table
I get the following error in Javscript console:

Error: ST_Transform exception - PROJ reports "proj_create: no database context specified".

Maybe proj dependency is missing? At least spatialite documenation does mention it at ST_Transform function: http://www.gaia-gis.it/gaia-sins/spatialite-sql-5.0.1.html

@geraldo you can pull latest code it is fixed now

Great, this does work now! Here a small test database with populated places from Natural Earth:
SELECT
    "name",
    X(TRANSFORM("GEOMETRY", 4326)) as long,
    Y(TRANSFORM("GEOMETRY", 4326)) as lat
FROM "naturalearth_populated_places_3857"

It also has 4326 projection:

SELECT
    "name",
    X("GEOMETRY") as long,
    Y("GEOMETRY") AS lat
FROM "naturalearth_populated_places_4326"


Add Redis cache for GitHub responses

Summary
The web app uses a Node.js cache-manager to cache all GitHub responses to prevent the web app from getting GitHub API rate limited. These GitHub requests vary from fetching repository information, traversing GitHub trees, to primarily fetching GitHub file content to read carbon.yml files and MDX files for web page content.
We're currently using a file system store engine (https://www.npmjs.com/package/cache-manager-fs-hash), which was chosen during v1 preview prototyping as a quick and easy way to prevent GitHub API rate limits.
As we index more content (asset documentation pages), each GitHub request per MDX file adds to the amount of cached responses. Our current build pipeline does not persist cached files written to disk between builds.
As the amount of indexed content grows, so does the risk of our production GitHub access tokens getting rate limited which could leave us with a production environment void of all content.
Potential solution
To mitigate that risk, until we can create proper back-end services for this, what if we added Redis stores for staging and production? It looks like we could use a Redis store listed here: https://github.com/BryanDonovan/node-cache-manager#store-engines
Those Redis store engines should share the same API as cache-manager-fs-hash, so that should require minimal web app changes.
We could keep the 1 hour TTL for cached responses, so for Next.js ISR pages, content from GitHub would be at most 1 hour stale.
With a Redis cache, our production builds should be faster because there's a greater chance of a cache hit.
We could use a Redis cache for local development too, or for simplicity, keep that with the current file system cache.
TL;DR:
In the event that our production environment gets rate limited by GitHub, because the Redis cache would be persisted, we wouldn't lose web app content between deploys. Also, it would be neat to see how many keys would get cached in Redis, to give us a better idea of to-be infrastructure needs to manage GitHub content.

Sub issues could be:

[ ] Provision services
[ ] Swap out engine stores
[ ] What's this mean for CI/CD?

Does this mean all pages would need to be ISR so we don't have to depend on an external service for production builds?

@jdharvey-ibm to migrate this issue to a technical design issue and close this once done.

Closing as not planned per @jdharvey-ibm's recommendation. We don't expect our current content needs will get GitHub API rate limited. We can re-evaluate our caching needs when we have a service in place that provides its GitHub data to the data graph. Assuming we have that, it's unlikely that we'll need a centralized data cache.


[Epic] Enable event-driven communication across the microservices

Tasks

[x]  #1216
[x] #1230
[x] #1232
[x] #1239

Update
Kafka is a messaging system that producer and consumer services can use to communicate. I have developed a working example of a producer sending a message to a Kafka topic. This message is then received by a consumer that listen to the Kafka topic.
Removing #1238 from the list because because it not a requirement to complete this Epic. Instead, This ticket will use the event-driven communication that has already been prototyped.


is ivshmem device supported in kubevirt 0.37.2?

Is this a BUG REPORT or FEATURE REQUEST?:

Uncomment only one, leave it on its own line:
/kind bug
/kind enhancement

What happened:
We are using kubevirt version 0.37.2 along with k3s.
Our requirement is to have ivshmem device attached the VM .
We see that ivshmem is not supported in this version kubevirt.
<test_pod># libvirtd --version
libvirtd (libvirt) 6.6.0
<test_pod># /usr/libexec/qemu-kvm  --version
QEMU emulator version 5.1.0 (qemu-kvm-5.1.0-16.fc32)
Copyright (c) 2003-2020 Fabrice Bellard and the QEMU Project developers
<test_pod># /usr/libexec/qemu-kvm -device ivshmem-plain,memdev=hostmem
qemu-kvm: -device ivshmem-plain,memdev=hostmem: 'ivshmem-plain' is not a valid device model name
However, We have downloaded qemu 5.1.0 source code and compiled. Seems ivshmem is enabled there.
[root@centos-vm2 qemu-5.1.0]# x86_64-softmmu/qemu-system-x86_64 --version
QEMU emulator version 5.1.0
Copyright (c) 2003-2020 Fabrice Bellard and the QEMU Project developers
[root@centos-vm2 qemu-5.1.0]#
[root@centos-vm2 qemu-5.1.0]# x86_64-softmmu/qemu-system-x86_64 -device ivshmem-plain,memdev=hostmem
qemu-system-x86_64: -device ivshmem-plain,memdev=hostmem: Device 'hostmem' not found
[root@centos-vm2 qemu-5.1.0]#
What you expected to happen:
ivshmem device support in kubevirt 0.37.2 version.
How to reproduce it (as minimally and precisely as possible):
Anything else we need to know?:
Please let us know if any configuration need to be added to enable ivshmem for kubevirt.
Environment:

KubeVirt version (use virtctl version):  [root@appliance-1 ~]# virtctl version
Starting to serve on <IP_ADDRESS>:8080
Client Version: version.Info{GitVersion:"", GitCommit:"d1ca2117f85c795772667101fa8819a2337c032a", GitTreeState:"dirty", BuildDate:"2021-07-13T16:10:43Z", GoVersion:"go1.13.14", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{GitVersion:"", GitCommit:"d1ca2117f85c795772667101fa8819a2337c032a", GitTreeState:"dirty", BuildDate:"2021-07-13T16:10:43Z", GoVersion:"go1.13.14", Compiler:"gc", Platform:"linux/amd64"}
[root@appliance-1 ~]#

Kubernetes version (use kubectl version): Client Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.1+k3s-cd32b0af-dirty", GitCommit:"cd32b0af2b374d494715b1aed3c65982dcb7d608", GitTreeState:"dirty", BuildDate:"2021-06-23T13:50:
22Z", GoVersion:"go1.15.2", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.1+k3s-cd32b0af-dirty", GitCommit:"cd32b0af2b374d494715b1aed3c65982dcb7d608", GitTreeState:"dirty", BuildDate:"2021-06-23T13:50:
22Z", GoVersion:"go1.15.2", Compiler:"gc", Platform:"linux/amd64"}

VM or VMI specifications:

Cloud provider or hardware configuration:

OS (e.g. from /etc/os-release):

Kernel (e.g. uname -a):

Install tools:

Others:

Hello,
ivshmem-plain and ivshmem-doorbell are supported in qemu - these are different from the deprecated ivshmem device.
I wonder what is the use case for enabling this in KubeVirt?

Hello,
ivshmem-plain and ivshmem-doorbell are supported in qemu - these are different from the deprecated ivshmem device. I wonder what is the use case for enabling this in KubeVirt?

Have you successfully use ivshmem feather in kubevirt? Can you provide me a use case?


Update AWS Fargate comparison

Thanks for writing this FAQ. A few minor corrections for Fargate:

Fargate doesn't require customers to manage their clusters. The cluster object (admittedly a misnomer) in Fargate does not correspond to any real compute infrastructure to be managed. It is just a way to logically separate your tasks, kind of similar to Kubernetes namespaces. You get a default one and creating a new one is completely optional. There is nothing to manage.

Fargate can also auto-scale to any custom metric defined by the customer, not just CPU and memory.

I think this is lgtm.
cc: @steren as fyi to review later.

Thanks.

I am concerned that the proposed change completely removes ECS from the picture. Any reason you did so?

@ofiliz specifically, I also just noticed that there seems to be an ECS dependency (in terms of choosing a cluster) here:
https://docs.aws.amazon.com/AmazonECS/latest/developerguide/ECS_GetStarted_Fargate.html#first-run-cluster
Is it a requirement to have an ECS cluster to use Fargate? If that's the case, we should add this part back.

No, you don't need to create an ECS cluster or any EC2 instances to use Fargate.
A Fargate cluster is a logical concept. Think a Kubernetes namespace, not a group of EC2 instances. When you use Fargate for the first time, a default cluster is automatically created for you, just like Kubernetes creates a default namespace for you. If you want to create new clusters (namespaces) to logically separate your tasks (pods), you can, but that's both optional and does not require you to manage any compute infrastructure.
This is what the UI mentioned in the link Ahmet shared above looks like. The default is pre-populated, you just click "next".

Admittedly we need to do a better job of explaining this in our documentation.

I think Fargate and Cloud Run is not apples to apples. Despite ECS seems to be virtual cluster concept and no EC2 nodes are visible (when used through Fargate), it's still very much an infra-oriented product.
The fact that "task" instances are visible to the user, autoscaling is not turned on by default, and many infra knobs are exposed, it makes it quite different than Cloud Run. The resource model of Fargate is vastly more complicated compared to Cloud Run, with many more knobs to configure to get up and running. It exposes many infrastructure details to the user, such as:

choosing subnets, VPCs
configuring a load balancer, and which type of LB to use
service discovery (albeit optional)
health checks
autoscaling (not enabled by default), user has to configure, which is nontrivial

Below are some screenshots from my journey, I'll be making a PR to update the section with my observations.

I think Fargate and Cloud Run is not an apples to apples comparison.
Yes, agreed. I don't think anybody made that claim. These two products have different requirements, addressing different audiences.

The only reason I've sent this PR was to correct inaccuracies in the original FAQ, such as "you [customer] are in charge of managing your cluster", "autoscaling is CPU/memory based" and "more suitable for containers that can be long-running". Fargate customers do not manage clusters, use autoscaling based on any custom metric, and run container lifetimes ranging from a few milliseconds to several months.
The differences you have listed in your observations above aren't necessarily good or bad, they are just different because the two products have very different goals. There are trade-offs. Fargate has more knobs, but is much more useful, flexible and addresses a much wider audience. It is all fair feedback as long as you emphasize that. :)
Thanks again for writing this FAQ!


Fix endless controller iteration on windows

Fixes #29846
Error introduced a couple of days ago in 68735d2a886bc2cf6b0a4300d1aa5ece952929ed
The iteration variable wasn't changed with the rename

My bad. Thanks for the fix!


Zerochan.net non categorized tags (characters/copyright etc)

Bug description
Zerochan tags aren't being parsed. Tried it while logged in and logged out
Steps to reproduce

Click on "sources".
Only enable "Zerochan" in the sources.
Click "ok".
Search anything.
Click on any of the images appearing on screen.
Check the tags.

Expected behavior
Parsed (coloured) tags that allows me to save images properly with filenames.
Context
main.log
(Can't upload settings as a .ini file)
settings - Copy.txt
Screenshots

System information

OS: [W10 version 2009]
Grabber version: [7.10.0]

Additional context
What it should look like

Indeed, it seems they changed the way they display image tags on their details page.
I'll push a fix ASAP.


blender: Cycles rendering too bright in NixOS 21.05

@chpatrick and I noticed that on NixOS 21.05, blender with its Cycles renderer renders incorrect images.
They are too bright (e.g. when loading a plain material with a texture and a simple Emission shader, or none at all).
The NixOS 21.05 (Blender 2.93.1, nixpkgs commit 056a3c1fae30d06d14b171b9023743c21a23ec1a) version renders the left one, it should render the right one:

The rendering is correct in:

The same version 2.93.1 of Blender on Ubuntu, bindist from the Blender website
Nixpkgs nixos-unstable commit 34ad3ffe08a, which has Blender 2.93.3

Because of this, we suspect that some blender dependency is broken.
In particular, we suspect opencolorio version 1.
The working nixos-unstable commit 34ad3ffe08a, has Blender depend on opencolorio v2 directly, and v1 via openimagio:
lddtree /nix/store/9n6dkriwz0w13f9ll05jzyfhg4cywsx7-blender-2.93.2/bin/.blender-wrapped
    libOpenImageIO.so.2.2 => /nix/store/gsrrn18brsc0j956k59r2sr7dbx1k5qz-openimageio-<IP_ADDRESS>/lib/libOpenImageIO.so.2.2
        libOpenColorIO.so.1 => /nix/store/vc3dq1snamfxjf7xv72yvgbvlq3br413-opencolorio-1.1.1/lib/libOpenColorIO.so.1
    libOpenColorIO.so.2.0 => /nix/store/pvq07z4mr0vma64rcpfqcmb7k4jc5ml4-opencolorio-2.0.2/lib/libOpenColorIO.so.2.0

The broken 21.05 version depends only on
	libOpenColorIO.so.1 => /nix/store/yfyipm5b3dpaak4lfxyf40s4jkj01inr-opencolorio-1.1.1/lib/libOpenColorIO.so.1

So my suspicion is that the direct opencolorio v2 fixes it.
Since it's fixed in unstable, I'm just leaving this here in case other NixOS 21.05 or general Blender users find this useful.

In Blender 2.93.5, one also has to set Render Properties -> Color Management -> View Transform to Standard (from Filmic) to get proper flat shading, like I am to do in my screenshots.

Since it's fixed in unstable, I'm just leaving this here in case other NixOS 21.05 or general Blender users find this useful.

Closing as planned.


Question on custom models

Hi,
without using transformers / accelerate blablabla, what are the constraints on the model to be tensor paralelizable ?
does it need to be a nn.Sequential ? does input dimensions need to be always in the same order ?
I am trying to load a model on two gpus but only the first is being allocated. (both are visible)

Hi @vince62s !
For a model to be tensor-paralleliazable automatically it should consist of basic Linear/Convolution/Embedding PyTorch layers. Other basic layers will still work but they will be replicated on each GPU. The problem with autoconfig may arise in runtime if those basic layers' weights are accessed directly (e.g. with linear.weight) since those accesses are not taken into account when planning device communications.
Otherwise, everything should generally work, especially when deploying the model, since it should deal with any PyTorch parameters and buffers no problem. If it's not the case for you, feel free to submit a more detailed report on your problem and I'll take a look.

ok, let me explain a bit.
When you use bitsandbytes to quantize (8it or 4bit) you need to load data in a layer and then call cuda() which triggers the quantization. Also you cannot call cuda() twice otherwise it screws up everything.
To overcome cpu ram usage when loading a big model here is what I do.
I build an empty model in cpu ram, then module by module I load data and move it to gpu module by module.
here is where it happens:
https://github.com/OpenNMT/OpenNMT-py/blob/master/onmt/models/model.py#L71-L92
now, I tried to use tensor_parallel at each module level (by modifying this code) and it only uses one gpu.

I'll have a more detailed look later, but right now you can try and take a look at how quantized deployment is done in tensor_parallel int4 demo on kaggle.

Are you quantizing the model before making it tensor_parallel? Because that wouldn't work. What you need to do is to create a model on CPU/meta, then make it tensor_parallel and only then dispatch it on GPUs (quantization happens during dispatch).
Here's a simplified example of how I did it for the Kaggle int4 demo:
import torch
import transformers
import accelerate
from transformers.utils.bitsandbytes import replace_with_bnb_linear

import tensor_parallel as tp

# Initialize a model on meta device (zero allocations)
with accelerate.init_empty_weights():
    model = transformers.AutoModelForCausalLM.from_config(...)

# Make it tensor_parallel
model = tp.TensorParallelPreTrainedModel(model)

# Mark linear layers to be quantized
model = replace_with_bnb_linear(
    model,
    quantization_config=transformers.utils.quantization_config.BitsAndBytesConfig(...),
)

# Load, dispatch and quantize the weights
device_map = tp.infer_sharded_device_map(model) # infer where to put each weight
for <EACH CHECKPOINT>:
    converted_state_dict = tp.convert_state_dict( # <- tensor_parallel helper function.
        torch.load(<CHECKPOINT PATH>),            #    Creates a tensor_parallel checkpoint form a normal one
        ...
    )

    # Dispatch the checkpoint
    for param_name, param in converted_state_dict.items():
        module_name = param_name
        while len(module_name) > 0 and module_name not in device_map:
            module_name = ".".join(module_name.split(".")[:-1])
        accelerate.utils.set_module_tensor_to_device(model, param_name, device_map[module_name], value=param)

From what I see, you're trying to use an already written dispatch code (from within load_state_dict). It probably will not work with tensor_parallel since it doesn't convert the state_dict and (obviously) doesn't check for internal tensor_parallel wrapper prefixes.
Please try and use accelerate to dispatch the model as shown in the int4 demo. If you have any questions I'll be happy to help!

I'll try but then you confirm that this line model = tp.TensorParallelPreTrainedModel(model) does not move anything to gpu, right ?

It does, unless the model is on meta device. Then it remains on meta device.

so it HAS to be on meta otherwise quantization won't work in the snippet above, am I correct ?

I am not seeing such print out. I tried various things as you mentioned but no luck.
can't figure out how to make this work.

Firstly, about tp.infer_sharded_device_map: it has nothing to do with tp.Sharded. I should probably rename it. What it does is that it simply creates a mapping of parameter name->parameter device. I created this function to simplify deployment with accelerate.
Secondly, about tp.Sharded: when trainable parameters are replicated on multiple GPUs with tensor parallelism (e.g. LayernNorm weights can't be split) we average them once in a while for them not to diverge. To do this, tp.TensorParallel can be wrapped with tp.Sharded with model = tp.Sharded(model). This needs to be done after model weights are loaded in and after they are properly frozen/unfrozen (to decide which weights need averaging). But to wrap tp.TensorParallelPreTrainedModel you need to do model.wrapped_model = tp.Sharded(model.wrapped_model) cause reasons. It's a hot mess and I was hoping to refactor it soon.
tldr: call tp.tensor_parallel(..., sharded=False) between 1) and 2). In 3) convert state dicts with tp.convert_state_dict and use tp.infer_sharded_device_map to determine on which GPU to put resulting weights. After 4) use tp.Sharded as described above.

but the issue is tp.infer_sharded_device_map works when being called before the bnb replacement (getting the mappign fine), but after I am getting the same error as above:
raise KeyError(
KeyError: "Can't decide where to put {name} in a sharded model state dict. Are you sure it's a sharded dict?"

I'll merge a PR fixing this message (and possibly a problem behind it) today. Then I'll be able to tell what goes wrong there.

well to be sure I just tested the kaggle notebook and to me it is still very unclear what is going on:
I am loading as a test the decapoda/llama-7b-hf
when printing the device_map, it returns all params duplicated on each device, for instance:
'wrapped_model.module_shards.0.model.layers.0.self_attn.tp_wrapped_module.q_proj.weight': device(type='cuda', index=0)
'wrapped_model.module_shards.1.model.layers.0.self_attn.tp_wrapped_module.q_proj.weight': device(type='cuda', index=1)
after the state_dict load both GPU are loaded with 13-14GB which means each of them carries the full model.
even more trouble some, in 4-bit I would expect the model footprint to be 4GB, split over two GPUs, hence 2GB each

'wrapped_model.module_shards.0.model.layers.0.self_attn.tp_wrapped_module.q_proj.weight': device(type='cuda', index=0)
'wrapped_model.module_shards.1.model.layers.0.self_attn.tp_wrapped_module.q_proj.weight': device(type='cuda', index=1)

Those are module_shards.0 and module_shards.1. They are supposed to have identical structure since those are two parts of the same model put on two devices.
As for 13-14GB for decapoda/llama-7b-hf: this should not be the case. The original demo showcases decapoda-research/llama-30b-hf which wouldn't physically fit if it wasn't properly quantized and split between two GPUs.

By the way v1.2.6 has just been released which fixes the error message discussed above and, hopefully, some other aspects of dispatch.

Those are module_shards.0 and module_shards.1. They are supposed to have identical structure since those are two parts of the same model put on two devices.
Then I don't undertsand anything. How is the model sharded on the 2 devices? layer N going to device 0 and layer M going to device 1? or part of layer N going device 0 and otehr part of layer N going to device 1 ?
I don't undertsand based on this device_map how things are dispatched.

As for 13-14GB for decapoda/llama-7b-hf: this should not be the case. The original demo showcases decapoda-research/llama-30b-hf which wouldn't physically fit if it wasn't properly quantized and split between two GPUs.

I updated the accelerate library and the footprint is ok now. so I need to see how to replicate this with my code.

As for 13-14GB for decapoda/llama-7b-hf: this should not be the case. The original demo showcases decapoda-research/llama-30b-hf which wouldn't physically fit if it wasn't properly quantized and split between two GPUs.

I updated the accelerate library and the footprint is ok now. so I need to see how to replicate this with my code.

Yes, fp4 support for dispatch was added only like a few weeks ago.

Those are module_shards.0 and module_shards.1. They are supposed to have identical structure since those are two parts of the same model put on two devices.

Then I don't undertsand anything. How is the model sharded on the 2 devices? layer N going to device 0 and layer M going to device 1? or part of layer N going device 0 and otehr part of layer N going to device 1 ? I don't undertsand based on this device_map how things are dispatched.

The entire point of this library is that each layer is split individually and each GPU has only a portion of each layer. This way all of the GPUs can be utilized simultaneously when using the model.

I think I'm not far but I have the feeling that the auto config does not work for  my model (remember it is not "PreTrained") so maybe I may have to make up a config.

On another note, would that be possible to have the same behavior with a model on "cpu" as on "meta".
If we build an empty model on "cpu" (with the skipt_init function) then we could also call tp.tensor_parallel() without actually moving to cuda and dispatch manually after that. The difference would be to avoid using that hacky method set_module_tensor_to_device(), we could just use param.to(device) it works.

On another note, would that be possible to have the same behavior with a model on "cpu" as on "meta".
If we build an empty model on "cpu" (with the skipt_init function) then we could also call tp.tensor_parallel() without actually moving to cuda and dispatch manually after that. The difference would be to avoid using that hacky method set_module_tensor_to_device(), we could just use param.to(device) it works.

That could come in handy. I'll see what I can do.


Adds subapprouter

This PR adds a notion of subapplications in preparation for adding a full page log viewer.
A SubApp is simply a handler for rendering and controller input. Menu is currently the only (and base) sub app, the router allows replacements for the menu to be pushed over the menu so they can handle input in different ways.
This should also pave the way for things like having an in-dash editor (popping a virtual keyboard) or a grid-based XBE launcher as an alternative to the menu list.

Converted to draft until the underlying PRs are approved.

Merge conflict, ready to merge

Rebased!

Thanks! :+1:


use air link

there is a way where i can use air link to test the game? build everytime i want to play make things very slow to develop

You can use Quest hand tracking in Unity Editor by setting the input data provider (IDP) called OVRInputSwitcher as HPTK.leftEditorIdp and HPTK.rightEditorIdp in the HPTK singleton. Input modules where InputModel.inputDataProvider == null will use their corresponding default IDPs referenced in HPTK singleton.
OVRInputSwitcher acts as intermediary between an IDP exclusive for hand tracking (OVRSkeletonTracker) and an IDP exclusive for controllers (UnityXRControllerTracker) so you can use hand trakcing or controllers.
The following image shows the modifications needed in the HPTK singleton to be able to use hand tracking in Unity Editor (using Link).

i've tried this, and still cant hit play and play in the editor, the camera don't recgonize my movements

Can you move your hands in PlayMode in a new scene using only OvrCameraRig and OvrHandPrefabs (without HPTK)?

This issue has received no response and will be closed.


Clock.Timer not firing correctly in API 26 builds

We have had a couple of reports about the Timer event of Clock not firing correctly on newer versions of Android when compiled with API 26 support. An initial look at the code shows it is likely not an issue related to background processing because Clock posts its timer messages on the main thread, just delayed by TimerInterval.

Based on the reports so far, it looks like this has just been affecting SDK 26 builds running on Android 8.0+.

Fixed by 3b3f7d0


Timebar color in chart editor

What feature do you want to get added on the base engine?
It will be possible to change the color of timebars in the chart editor! Lua scripts are tired
To test your sight, and reliability, please select the option of what should NOT be requested.
Stage Editor, 6K+ support, and winning icons.

dont repost issues

you already failed the test

You failed th- Oh no wait, that just the Cassette Girl Mod feature. But in the chart editor, why do you want this feature?

you failed the test again

Terrible idea to put it on the Chart Editor.


Add files via upload

What does this PR do?
required
Where should the reviewer start?
required
Why is it needed?
required

All right


User need to enter 'Add Org' data again if they navigate to privacy or terms& condition links

Open "https://staging.fightpandemics.work"
Navigate Profile -> Add Organization
Enter the details to create new Organization.
Click on 'Privacy Policy' or ' Terms and Conditions' link
Click on 'BACK' button of the browser to come back to finish adding new Organization

Issue: You will observe that user's entered data to create Organization profile is deleted and user need to re-enter all the details.
Refer attached GIF.
https://share.getcloudapp.com/YEupky7y

@vikjoshi FYI

Easy solution for this will be to have those links open up on a new tab. What do you think @rabbi08 ?

Easy solution for this will be to have those links open up on a new tab. What do you think @rabbi08 ?

Yeah that's will be quick and easy fix. Thnx

@rabbi08 @idjevm, given that this is not urgent, i will prioritize this for MVP release, not soft launch


com.google.apps.framework.request.BadRequestException: Path '' does not match template

Environment details

OS: Windows 7  Professional
Node.js version: v10.15.3
npm version: 6.4.1
dialogflow version: 0.10.2

Steps to reproduce
I'm using the dialogflow nodejs client to send requests to my agent using detectIntent.
I'm getting a response to my request with output context in below format
projects/{project-id}/agent/sessions/{3d2....8}/contexts/context-accept-product-param
In my next request with user query text, I'm adding the same context above.
But I'm getting an error like below:
(node:10728) UnhandledPromiseRejectionWarning: Error: com.google.apps.framework.
request.BadRequestException: [ResourceName error] Path '' does not match templat
e 'projects/{project_id=}/agent/environments/{environment_id=}/users/{user_id=
}/sessions/{session_id=}/contexts/{context_id=*}'.
at Http2CallStream.call.on (D:\Work\node_modules@grpc\grpc-j
s\build\src\client.js:96:45)
at Http2CallStream.emit (events.js:194:15)
at process.nextTick (D:\Work\node_modules@grpc\grpc-js\build
\src\call-stream.js:71:22)
at process._tickCallback (internal/process/next_tick.js:61:11)
I've setup all code to use version V2, not V2Beta anywhere. So why am i getting this error for same context path which was returned in last response and used in next request.
In my dialog flow chat settings also i have not enabled V2beta version.
`const dialogFlow = require('dialogflow').v2;
let sessionId = uuid.v4();
let sessionClient = new dialogFlow.SessionsClient();
let sessionPath = sessionClient.sessionPath(projectId, sessionId);
sessionClient.detectIntent(request).then(responses => {});
`
Error is thrown where i make call to detectIntent.
Kindly someone please help or comment on this.
Thanks in advance!
Kapil

@kapil-joshi did you ever get this issue resolved? If not would you be able to share with us how you're setting the context in the request?


createSkinnedMesh helper

I think we should add a new function or extend createMesh that would create a mesh that has the options for pc.SEMANTIC_BLENDWEIGHT and pc.SEMANTIC_BLENDINDICES
Something like:
var positions = [];
var normals   = [];
var uvs       = [];
var indices   = [];
var blendIndices = [];
var blendWeights = [];

var options = {
  normals : normals,
  uvs     : uvs,
  indices : indices,
  blendIndices: blendIndices,
  blendWeights: blendWeights
};

var mesh = pc.createMesh(app.graphicsDevice, positions, options);

Fixed by #786 so closing


Added 8021q kernel module for VLAN support

Closes #211

If some VLAN should be used or not has to be configured in the networkmanager profiles, as if you want to configure a WiFi connection. But yes, ip link add link eth0 type vlan id 123 is enough to have the 8021q module loaded automatically.

Hello, how can I update my Hass OS installation to enable VLAN support? Then, how can I configure the functionality and, above all, make the config permanent?

@scottini Either build it yourself with the changes I made (not recommended if you are completely unfamiliar with those sort of things) or wait until it gets released.
Anyway, you'll find how to create VLAN connections in the NetworkManager docs. After all, it's just plain NM connection profiles. The installation tutorial mentions how to provide external connection profiles to hassio.


HBASE-21257 misspelled words.[occured -> occurred]

This PR is used to replace PR#91. The modification only involves spelling errors in the words in the comments, and does not affect the program function. PR#91 will be closed and the modified content will not be merged into the master branch.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

0
reexec
25
Docker mode activated.

_ Prechecks _

+1
hbaseanti
0
Patch does not have any anti-patterns.

+1
@author
0
The patch does not contain any @author tags.

+1
test4tests
0
The patch appears to include 1 new or modified test files.

_ master Compile Tests _

0
mvndep
26
Maven dependency ordering for branch

+1
mvninstall
263
master passed

+1
compile
107
master passed

+1
checkstyle
95
master passed

+1
shadedjars
275
branch has no errors when building our shaded downstream artifacts.

+1
findbugs
231
master passed

+1
javadoc
69
master passed

_ Patch Compile Tests _

0
mvndep
15
Maven dependency ordering for patch

+1
mvninstall
251
the patch passed

+1
compile
110
the patch passed

+1
javac
110
the patch passed

+1
checkstyle
98
the patch passed

+1
whitespace
0
The patch has no whitespace issues.

+1
shadedjars
280
patch has no errors when building our shaded downstream artifacts.

+1
hadoopcheck
527
Patch does not cause any errors with Hadoop 2.7.4 or 3.0.0.

+1
findbugs
250
the patch passed

+1
javadoc
65
the patch passed

_ Other Tests _

+1
unit
8840
hbase-server in the patch passed.

+1
unit
70
hbase-it in the patch passed.

+1
unit
260
hbase-rest in the patch passed.

+1
asflicense
88
The patch does not generate ASF License warnings.

12045

Subsystem
Report/Notes

Docker
Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-146/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/146

Optional Tests
dupname  asflicense  javac  javadoc  unit  findbugs  shadedjars  hadoopcheck  hbaseanti  checkstyle  compile

uname
Linux 6eb425996922 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 GNU/Linux

Build tool
maven

Personality
/testptch/patchprocess/precommit/personality/provided.sh

git revision
master / 16146a1839

maven
version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)

Default Java
1.8.0_181

findbugs
v3.1.11

Test Results
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-146/1/testReport/

Max. process+thread count
4922 (vs. ulimit of 10000)

modules
C: hbase-server hbase-it hbase-rest U: .

Console output
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-146/1/console

Powered by
Apache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.


add sendPoll method

this method is used to send a native poll.

Thank you, @pedroaf0
Available at 1.3.4


[rancher alerting drivers]  add links to the upstream examples

What kind of request is this (question/bug/enhancement/feature request):
enhancement
Currently, when SMS is enabled, A configmap for rancher-sachet is created with no content.
For a better user experience, we can add the link to the upstream and examples as comments in rancher-sachet's configmap.
Sample result:

tested on v2.5.8-rc10:

installed SMS via rancher-alerting-drivers chart
in the sachet configmap, now there is a template (just as it appears in Jack's screenshot above) to help the user configure their sms alerts


Testing the nuxt/content module?

Hi there
I am looking for a way to integration test my nuxt app with Jest, that is using both the nuxt/content and vuex.
Do you happen to have any examples for how to test these, or can you point me in the right direction?
Best
Agata

Related #95


How to calculate the used storage space

I want to calculate the size of space used by a library. Is there any way to do that?

localForage does not have an API to detect the amount of storage used. There's some discussion about extending the storage spec with this info: https://github.com/whatwg/storage/issues/63


DoT & DoQ support

With the recent release of connect() for making outbound TCP connection in Cloudflare Workers, it's technically possible to currently write a forwarding to DoT servers instead DoH, and in the future, once the support for inbound TCP and QUIC is added, also forwarding from DoT & DoQ to any DoH, DoT, and DoQ server.
However, aside from the nonzero effort to learn about the new API and implement them, forwarding DoH GET requests to DoT/DoQ will be slightly more involved than simply forwarding DoH POST to DoT/DoQ, since the URL in DoH GET must be decoded first.
The actual benefit of extending support for DoT & DoQ will be minimal, for outbound, most servers that support DoT & DoQ likely support DoH too, and for inbound, if a government blocks DoH servers, then they likely already block DoT & DoQ entirely by closing down port 853.
Minimal doesn't mean none, Inbound DoT is very practical for Android users due to its native support, and even with an outbound that already supports DoT, using Cloudflare's cert avoids the dilemma in LetsEncrypt where supporting newer Android DoT means abandoning older Android DoT, and vice versa. So if someone creates a pull request about DoT/DoQ support, I will still review it.

DoH GET requests are auto-cached, so that's one optimization using DoT wouldn't have. That said, DNS over UDP is super fast in comparison to DoH / DoT. But, Cloudflare hasn't released that features since announcing it 2 (?) years ago. I'd imagine it involves a significant rewrite of their DDoS and other such tooling.