Public preview

Article states that 'This Workday user provisioning solution is presently in public preview'. Is that still the case, since it has been available for quite some time now?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 799c371a-a17e-08aa-ef56-86eef2395f7e
Version Independent ID: 1339cc93-712c-3a32-8321-dfd016a50ed4
Content: Tutorial: Configure Workday for automatic user provisioning with Azure Active Directory
Content Source: articles/active-directory/saas-apps/workday-inbound-tutorial.md
Service: active-directory
GitHub Login: @asmalser-msft
Microsoft Alias: asmalser

Thanks for the feedback! We are looking into this and will get back to you shortly.

@nebur634 Thanks for the feedback !  I have assigned this issue to content author to investigate and update the document as appropriate.

Thanks SaurabhSharma-MSFT. What's the expected ETA on the update?

Any update? I was quite happy to see a quick pick-up on my initial question, too bad the actual answer takes almost more than 2 weeks!

Yes, as of today the Workday inbound provisioning connectors are still in public preview. In addition to the existing body text, the title has been updated to make this clearer. #please-close

Hi, when is GA for 'This Workday user provisioning solution" ?

I have the same question as above, what is the General Availability date? Also, if a Workday customer is implementing this, who should they reach out to with issues such as sync failures, follow-up questions on scenarios that the integration handles?


Clean up views.

Pulled out a little of clean-up stuff from https://github.com/pwnall/seven/pull/132

Thank you!


Error while uploading video

Hi Team, i use this tool over my Powershell Engine,
since i uploaed successfully 3 videos since their it runs in error
I highlight the Errocodes in BOLD
Syntax i checked multiple times and works all correct,
but it failes after/in upload see LOG
Any Idea?

same problem here...


OTBR sends Multicast Listener Report Message V2 to the Thread network

Describe the bug
OTBR sends Multicast Listener Report Message V2 multicast to the Thread network when it attaches, bringing significant and unnecessary network traffic.
To Reproduce
It happens when a OTBR device joins a Thread network.
Expected behavior
OTBR should not send this message to the Thread network
Console/log output
Packet frame:
Frame 88: 94 bytes on wire (752 bits), 94 bytes captured (752 bits) on interface 0
Ethernet II, Src: 22:22:22:22:22:22 (22:22:22:22:22:22), Dst: Broadcast (ff:ff:ff:ff:ff:ff)
IEEE 802.15.4 Data, Dst: 0x0400, Src: 16:6e:0a:00:00:00:00:1d
6LoWPAN
    Fragmentation Header
    [2 Message fragments (176 bytes): #86(128), #88(48)]
Internet Protocol Version 6, Src: fe80::146e:a00:0:1d, Dst: ff02::16
    0110 .... = Version: 6
    .... 0000 0000 .... .... .... .... .... = Traffic Class: 0x00 (DSCP: CS0, ECN: Not-ECT)
    .... .... .... 0000 0000 0000 0000 0000 = Flow Label: 0x00000
    Payload Length: 136
    Next Header: IPv6 Hop-by-Hop Option (0)
    Hop Limit: 1
    Source: fe80::146e:a00:0:1d
    Destination: ff02::16
    IPv6 Hop-by-Hop Option
Internet Control Message Protocol v6
    Type: Multicast Listener Report Message v2 (143)
    Code: 0
    Checksum: 0x2a9c [correct]
    [Checksum Status: Good]
    Reserved: 0000
    Number of Multicast Address Records: 6
    Multicast Address Record Changed to exclude: ff33:40:fd00:db8::1
    Multicast Address Record Changed to exclude: ff32:40:fd00:db8::1
    Multicast Address Record Changed to exclude: ff03::fc
    Multicast Address Record Changed to exclude: ff03::1
    Multicast Address Record Changed to exclude: ff02::16
    Multicast Address Record Changed to exclude: ff02::2

Some other packets to ff02::16 that wireshark can not dissect.

I think we can fix it by one these solutions:

Parse the IP6 header in processTransmit of posix/platform/netif.cpp and skip such messages
Ip6::SendRaw drop multicast packets with link local scope (very simple to implement, but not sure if it's proper)
Use ip6tables rules to drop such packets in the wpan0 interface.

Thoughts? @librasungirl @bukepo @jwhui

Yes, I prefer filtering unsupported packets inside OpenThread's IPv6 stack(src/core/ip6.cpp), which helps all platforms.

Closing stale issue.


Add "Persian numbers to English numbers functionality"

I needed converting Persian numbers to English numbers, i found this library and i taught i can add this functionality myself, I'll be glad if you commit these changes.
Thanks,
Ala Alam Falaki

@mhshakouri happy to transfer the ownership of this repo. a bit busy to manage this repo.


App: debug VOX loader

The VOXLoader broke in the update to THREE.js r128.
We need to reimplement Face3 + Geometry (LegacyGeometry).

We might be able to re-use the legacy geometry which seems to be retained as an example: https://github.com/mrdoob/three.js/blob/342946c8392639028da439b6dc0597e58209c696/examples/js/deprecated/Geometry.js


remove magic number

#899

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.wanghaitao01 seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

有些问题： FLAGS_chunkserver_disk_safe_space << 20， 而原代码是5<<30， 也就是说单位是GB，现在变成了<<20， 也就是MB，这是一个问题。 还有FLAGS_chunkserver_disk_safe_space并没有任何单位的标识，那其他人看到这个变量如何得知它的单位呢？ 建议使用： FLAGS_chunkserver_disk_safe_space_GB 这样的词汇更能见名知意。

@lpstudy flags.cc这个文件里说明了这个变量的单位


writing incomplete data to a writestream should throw

e.g. writeStream.push({key: 'foo'}) currently silently fails but it should throw/error if value and type aren't specified

5.0.0 throws if .key isn't specified (.key is the only required one)

should we make value and type required?


Added draw functions to ImageDraw*() #1028

Added draw functions:
ImageClearBackground()
ImageDrawPixel()
ImageDrawLineEx()
ImageDrawCircle()

@iamsouravgupta wow! great addition! thank you very much for the contribution! :)


ImportError: No module named lib.data

Hi, @samet-akcay
At this time, I met this error.
File "train.py", line 22, in
from lib.data import load_data
ImportError: No module named lib.data
What's wrong with me?
Thanks, at any rate.
from, @bemoregt.

This is peculiar. If you correctly download or cloned the repository, then the file should be there. If you browse to lib folder, you'll see data.py, inside of which there is load_data function.

Due to the inactivity, I assume this has been resolved, and am closing the issue.

I guess the problem is that you didn't create an empty file init.py in lib directory, then it fails when executing sh experiments/run_mnist.sh
See below:
hugues@duncan:~/ganomaly$ sh experiments/run_mnist.sh Manual Seed: {0..2} Running mnist_{0..9} Traceback (most recent call last):   File "train.py", line 21, in <module>     from lib.data import load_data ImportError: No module named lib.data hugues@duncan:~/ganomaly$ ls lib/ data.py  evaluate.py  loss.py  model.py  networks.py  visualizer.py hugues@duncan:~/ganomaly$ touch lib/__init__.py hugues@duncan:~/ganomaly$ sh experiments/run_mnist.sh Manual Seed: {0..2} Running mnist_{0..9} usage: train.py [-h] [--dataset DATASET] [--dataroot DATAROOT]                 [--batchsize BATCHSIZE] [--workers WORKERS] [--droplast]                 [--isize ISIZE] [--nc NC] [--nz NZ] [--ngf NGF] [--ndf NDF]                 [--extralayers EXTRALAYERS] [--gpu_ids GPU_IDS] [--ngpu NGPU]                 [--name NAME] [--model MODEL]                 [--display_server DISPLAY_SERVER]                 [--display_port DISPLAY_PORT] [--display_id DISPLAY_ID]                 [--display] [--outf OUTF] [--manualseed MANUALSEED]                 [--anomaly_class ANOMALY_CLASS] [--proportion PROPORTION]                 [--metric METRIC] [--print_freq PRINT_FREQ]                 [--save_image_freq SAVE_IMAGE_FREQ] [--save_test_images]                 [--load_weights] [--resume RESUME] [--phase PHASE]                 [--iter ITER] [--niter NITER] [--beta1 BETA1] [--lr LR]                 [--w_bce W_BCE] [--w_rec W_REC] [--w_enc W_ENC] train.py: error: argument --manualseed: invalid int value: '{0..2}'

The problem is the Python version. If you run the code on Python 2, this problem occurs. On Python 3, on the other hand, it runs flawlessly.

The problem is the Python version. If you run the code on Python 2, this problem occurs. On Python 3, on the other hand, it runs flawlessly.

So how this could be resolved if using python 2.*?

I've modified the respective part of the code. Now it works with Python2 as well.


Image preview CTRL+Wheel zooming inverted after attempting to drag image

Issue Type: Bug
Similar issue as #48514 but I managed to find a way to reproduce it (occurs at least on previews, been unable to test on comparisons, but if it occurs on simple previews I'd imagine it's likely for all image displays).
Searching issues leads to a lot of references to #43138, possibly related?
Steps to reproduce:

Launch Code
Open an image
CTRL+mouse wheel should correctly zoom in with scroll up, and out with down.
Attempt to pan the image by left-click and dragging (not something Code seems to support).
Scroll zoom should now be inverted.

Restarting Code usually fixes it until reproduced again, but not always. Re-launching without an image open and opening/scrolling in some other text-based files seems to help.
Does this issue occur when all extensions are disabled?: Yes
VS Code version: Code 1.25.1 (1dfc5e557209371715f655691b1235b6b26a06be, 2018-07-11T15:43:53.668Z)
OS version: Windows_NT x64 6.1.7601

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz (8 x 3408)

GPU Status
2d_canvas: enabledflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onnative_gpu_memory_buffers: disabled_softwarerasterization: disabled_softwarevideo_decode: enabledvideo_encode: enabledvpx_decode: unavailable_softwarewebgl: enabledwebgl2: enabled

Memory (System)
7.89GB (2.46GB free)

Process Argv
C:\Program Files\Microsoft VS Code\Code.exe [Workspace folder path, redacted as contains private work info]

Screen Reader
no

VM
0%

Extensions (9)

Extension
Author (truncated)
Version

bracket-pair-colorizer
Coe
1.0.59

tslint
eg2
1.0.34

vscode-npm-script
eg2
0.3.5

vscode-todo-plus
fab
2.2.1

vscode-firefox-debug
hbe
1.4.3

svn-scm
joh
1.31.0

debugger-for-chrome
msj
4.8.2

material-icon-theme
PKi
3.5.2

vscode-todo-highlight
way
1.0.4

(1 theme extensions excluded)

Does this still reproduce in the latest VS Code insiders build?

Latest insiders seems to be always inverted.

It's always inverted for me (not insiders).

I would like to give it a try.


Added linux support

My fork is a manual merge of alexchandel/screenshot-rs and posixphreak/screenshot-rs (with some bug fixes on posixphreak/screenshot-rs) which adds linux support (it has been fully tested).

Thanks!

Thank you for building this amazing library!
P.S.: You may want to delete the disclosure I added in README.md. Sorry for the inconvenient.

No problem. Watch out for the memory leaks in the OSX & Windows versions, I haven't had the need to remove them yet...


Creating scratch note without an open file results an error

Describe the bug
Invoking "create scratch note" without any file opened results the following error:
Command 'Dendron: Create Scratch Note' resulted in an error (Cannot read property 'selection' of undefined)
Expected behavior
New scratch note created to root?

You're really killing it with the bug finding 😅
Good find, this is caused by this line
It shouldn't throw an error if the note add behavior === asOwnDomain.
If you feel up to it, would you consider making a pull request? This should be a one line change and I already have integration tests for new note creation (docs to run tests)
If you pull the latest changes from Dendron, I should have fixed all the build errors too so it should just work now.
If you can't, no worries either. I'll probably update it first thing next week!


Fix self:update command on Windows.

Thanks for taking the time to make this PR. However, this has been fixed (along with other things) in commit 043b9ec99481706f47c0ef47768eea0ed55bc688 on the master branch.
So I am closing this but thanks again!


Prepare exit handler & Add missing arg to test connection

Describe your changes :

Add the exit handler script to be used as an exit call for the Argo Workflows. It will be used to update the status if the workflow init fails or Argo explodes during the execution

Type of change :

[x] Bug fix
[x] Improvement
[x] New feature
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation

Frontend Preview (Screenshots) :
For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.
[ ] I have commented on my code, particularly in hard-to-understand areas.
[ ] I have added tests that prove my fix is effective or that my feature works.
[x] All new and existing tests passed.

Reviewers

@pmbrull will that script be call from an argo workflow step itself as a call back on termination?


Wrapping code in IIFE -- no other changes

Wrapping entirety of code in an immediately-invoked function expression.
demo: http://jsfiddle.net/tmj2powk/3/
rationale: http://benalman.com/news/2010/11/immediately-invoked-function-expression/
Although the diff looks really funky, all I did was indent the code and wrap it.  :smile:

Same error as last time,
ReferenceError: clickSpark is not defined
on the last demo point "Independent particle binding"
with this wrapping the clickSpark var is not directly callable
$(document).ready(function () {
  $('.button-4').click(function () {
    clickSpark.fireParticles($('.sparklingDiv'));
  });
});


dotnet test should not build if project already built

From @ardalis on June 14, 2017 16:47
Steps to reproduce
Run dotnet test. It will build.
Run dotnet test again. It will build. It doesn't need to.
Expected  behavior
Run dotnet test. It will build (if necessary).
Run dotnet test. It will simply run tests.
Actual behavior
See above.
Environment data
dotnet --info output:
Copied from original issue: dotnet/cli#6868

@livarcocc I am not sure how this can we handled on the test platform side. This would actually require dotnet verb design change.
When dotnet test is called, dotnet build gets called implicitly. Is there a way for dotnet test command to be aware of the state of the build. and then skip?
Ideally, build should get invoked as expected and this decision should be with the build command.
But then, I am not sure if build has the capability to identify if the new build request is redundant.
Can you please share your thoughts ?

While build is invoked, it should not be changing assemblies as incremental build should kick in and skip compilation and additional build work. So, build is already deciding when to actually build or not. However, many things may contribute to force a build to happen. I am not sure that test is doing such a thing or not. if you are confident it is not, I would just close this issue.
Also, dotnet test supports the --no-build flag, if the user does not want even incremental builds to run, then pass that flag.

Yes, I just verified the behavior, it just prints build started, and completed. It skips the compilation if it is not required.
And yes --no-build flag works as expected.
Validated using dotnet version = 3.0.100-preview-010184
Closing this issue now.


Move version 2 to a subdomain

Just like other documentation practices, keeping this version on a separate branch with a different subdomain would be beneficial for historical purposes and to avoid cluttering the main documentation that is subject to changes.

I think that is a good idea! We can have a look in our infra and try to do the settings for this. What do you think @crandmck?

By separate sub-domain, do you mean that all the 5.x doc would be at something like v4.expressjs.com?  This is an interesting approach, but differs from what we've been doing, where each version's API reference is maintained  separately, e.g. https://expressjs.com/en/4x/api.html and https://expressjs.com/en/3x/api.html while the rest of the documentation is for the current version (4.x now, and once v5 is released, it would be 5.x).

...to avoid cluttering the main documentation that is subject to changes.

To be clear, changes are primarily in the latest/upcoming version (5.x). The older version(s) that are in bug-fix/maintenance mode typically doesn't require doc updates so the docs docs are basically "frozen" (except for stuff like correcting existing errors).
This idea is worth considering, since of course we need to maintain 4.x docs to help people maintain existing v4 apps.  However, once 5.x is released, we don't want to encourage anyone to install or use v4 as a "new user" so we'd want to remove all the v4 "Getting started" material.  If there's an argument for keeping it, I'd like to understand it.
All the info under the "Resources" menu is not version-specific, and duplicating it is not a good idea.  Exception: I'm not sure about the Middleware. I assume most middleware will be usable by either v4 or v5, but perhaps there are special cases?
Most of the info under the "Advanced" menu is best practices (e.g. security and performance) which are not likely to differ much between v4 and v5.  I'm not sure about Developing template engines -- it may need updates for v5, but I presume we don't want to encourage people to create new template engines for v4, so I suspect we should keep only a version for v5.
So, for the most part, the only v4 doc that should be maintained/duplicated is the API doc and everything under the "Guide" menu (modulo the migration guides).  Since we already version the API docs, this proposal boils down to also versioning most of the "Guide" material.  Does it make sense to have a subdomain just for that?

My idea was that this change should be only for version 2, since it’s a version that follows its own style, structure, and content (guides, screencasts, and applications) on the website. Version 3 and later should remain as they are

Ah, sorry I misread the title somehow...
Honestly, I would prefer if we could just remove the v2 docs.  It's so outdated, and doubtful that anyone is even using it still. When v5 is released, it will be 3 major versions behind.   I don't think it's worth spending much time to maintain it, so I'd vote to remove it altogether.  We should get consent from the @expressjs/express-tc , though.


Can we please add the SMTP endpoint for GCCH

smtp.office365.us.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 9a9f2948-6ae1-f907-836b-07f108ddf828
Version Independent ID: 9a9f2948-6ae1-f907-836b-07f108ddf828
Content: Office 365 U.S. Government GCC High endpoints - Microsoft 365 Enterprise
Content Source: microsoft-365/enterprise/microsoft-365-u-s-government-gcc-high-endpoints.md
Service: microsoft-365-enterprise
GitHub Login: @kelleyvice-msft
Microsoft Alias: kvice

@J227668 Thanks for reaching out to the Microsoft 365 Enterprise content team. Because all Microsoft 365 endpoints data displayed in learn.microsoft.com articles is autogenerated by the Microsoft 365 endpoints web service, the content team cannot resolve issues directly related to this data.
We recommend you contact the engineering team associated with the endpoint in question.
Hope this helps!
Thanks
Sri


Glimmer DSL for LibUI Wins Fukuoka Ruby 2022 Special Award

https://andymaleh.blogspot.com/2022/02/glimmer-dsl-for-libui-wins-fukuoka-ruby.html
http://www.digitalfukuoka.jp/topics/187?locale=ja
This is just a celebratory issue and a big thanks to @kojix2 for contributing to the win of Glimmer DSL for LibUI at the 2022 Fukuoka Ruby Award Competition!
Take this as a great encouragement that the C libui and LibUI Ruby bindings have won indirectly too after Glimmer DSL for LibUI has been presented to and reviewed by Matz, the creator of Ruby, at the 2022 Fukuoka Ruby Award Competition!
I hid from you before the fact that Glimmer DSL for LibUI got selected as a finalist in Fukuoka Ruby Award Competition 2022 because I wanted to receive the final results first, which just came back!
Cheers and keep LibUI alive and greatly useful!!!
CC @rubyFeedback

Wow!
I was surprised 😲 😊


[HUDI-5811] Specify the artifact of protoc to solve the problem that cannot be compiled on m1 mac

HUDI-5811
Background
I encountered the same problem as in the issue. I couldn’t compile Hudi on the m1 mac. Following the suggestions in the issue still couldn’t solve it. Because I have encountered similar problems on spark. By referring to the configuration of pom.xml in spark, the configuration of protoc artifact is added to Hudi, and the problem is solved.
Change Logs
add the artifact of protoc to pom.xml
Impact
no
Risk level (write none, low medium or high below)
none
Documentation Update
Contributor's checklist

[ ] Read through contributor's guide
[ ] Change Logs and Impact were stated clearly
[ ] Adequate tests were added if applicable
[ ] CI passed

@huangxiaopingRD please describe details why this change is needed.

@huangxiaopingRD please describe details why this change is needed.

ok, details have been added


enhance ui and fix layout problems

related to #54

Introduces some UI enhancement to fix inconsistencies and match the real chatgpt.
Fix some layout problem on different viewports that severely damage the experience

Absolutely incredible contribution. Thanks you so much from me and the community!


No way for 'chosen' name to go through to HomeKit?

Describe Your Problem:

Each of my sensors have a name (Garage, Office, Small/Large Bin). Each of those I have set up in the UI to have that name, but when looking at HomeKit (and the 'Name' section in the accessory) It is the GVH5101XXXX. I was wondering if instead of those names going to HomeKit, the 'chosen' name given in the UI could instead (if set).
Logs:
[1/2/2022, 9:09:27 PM] [Govee] Restoring existing accessory from cache: GVH51011234
[1/2/2022, 9:09:27 PM] [Govee] Restoring existing accessory from cache: GVH51015555
[1/2/2022, 9:09:28 PM] [Govee] Restoring existing accessory from cache: GVH51016633

Plugin Config:
{
"name": "Govee",
"batteryThreshold": 25,
"debug": false,
"humidityOffset": 0,
"platform": "GoveeHomebridgePlugin"
}

Screenshots:
None
Environment:

Plugin Version: 1.1.4
Homebridge Version: 1.3.9
Node.js Version: 14.18.2
NPM Version:  6.14.15
Operating System:  Ubuntu

This is a duplicate of https://github.com/asednev/homebridge-plugin-govee/issues/30. At this time, I don't see a way to get the device name from data broadcasted over BLE. Most likely Govee maintains device name in the iOS app.

One question beyond that - HomeBridge let's you name the accessories- could that not be read and sent back to HomeKit?


Fix unused variable warnings from C/C++ compilers in generated code

If both __setitem__ and __delitem__ special methods are defined, then there is no need to get the type name to report an unsupported operation.

@MatzeB Are you OK with this minor fix?

Thanks. Slight improvement committed as 206adb4.


"Client Incompatible!" message when launching with java Realms

Describe the bug
using FO with Java Realms prompts the message - "Your client is not compatible with Realms. Please use the most recent version of Minecraft."
client is updated and able to log in normally. only difference is when using FO with CurseForge to login vs the normal Minecraft client.
Modpack version
Fabulously Optimized-4.5.6.zip
Launcher
CurseForge Launcher
Other things

[ ] I updated FO to a newer version (mention, what version to what version)
[ ] I added/removed some mods or resource packs (mention, which ones)

Additional context
No response

Well exactly as the version says Realms only support the latest version of Minecraft aka 1.19.3 currently
FO 4.5.6 is Minecraft 1.19.2
You need to either use FO 4.6.0 or to change of server hosting

Realms has updated to 1.19.3 - so you must use the beta version of FO for 1.19.3 (currently 4.6.0-beta.10), because 4.5.6 is for 1.19.2, which Realms no longer supports.

Not an FO issue.


color setting issue

Description of the problem or steps to reproduce
default "#00A000,#000000"
results in a white background
default "#00A000,#001000"
looks like a black background
default "#00A000,black"
white background
Specifications

Commit hash: cfcb2e45
OS: Mine Mate 20.1
Terminal: mate-terminal 1.24.0

Hey, I want to change background color of my website. Can I use this coding to solve my issue.
Thanks in advance.


[ENH] Introduce SegmentUuid

Description of changes
Summarize the changes made by this PR.

Improvements & Bug fixes

...

New functionality

...

Test plan
How are these changes tested?

[ ] Tests pass locally with pytest for python, yarn test for js, cargo test for rust

Documentation Changes
Are all docstrings for user-facing APIs updated if required? Do we need to make documentation changes in the docs repository?

#3099  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @Sicheng-Pan and the rest of your teammates on  Graphite


titiler-cmr statistics endpoint design

Motiviation
There is a need to deliver statistics API endpoints. It is still to be determined if this lives in a titiler-cmr API or a different API. Other data sources also require a statistics endpoint. First task will be to gather requirements.
Acceptance Criteria

[ ] ADR or other design document describing the problem and proposing a solution. The solution should include an API design and architecture design.

what endpoints do the platforms need?

GET /statistics: retrieve stats of the full dataset
POST /statistics: retrieve stats for a geojson

Note:
the first (GET) one will be really hard to achieve, because we don't want / can't read all the dataset in memory
the second (POST) one could be hard if we don't set max-area limit to make sure we don't read too much data

From Brian F:
We need what you can get from titiler off cogs, we want same statistics from titiler CMR. When a user draws boundaries

drill through AOI for whatever timeseries, min, max, std deviation and sum
and plot it as a time series
cap it at 3000 points

@vincentsarago @anayeaye I have modified this issue to return to the question of timeseries generation. Henry will be starting to work on a design document so if you have any other ideas or considerations please add them here!

I think the cleanest way to add timeseries functionality to titiler applications would be to create a TimeSeriesMixin class in a new app titiler.timeseries that could be combined with a tiler factory like titiler.cmr.factory.Endpoints to extend the vanilla versions of whatever endpoints we want.
titiler.timeseries would look something like:
# titiler/timeseries/dependencies.py
@dataclass
class TimeSeriesParams(DefaultDependency):
    """Time series parameters"""

    start_datetime: Annotated[
        datetime,
        Query(
            description="Start datetime for time series request",
        ),
    ]
    end_datetime: Annotated[
        datetime,
        Query(
            description="End datetime for time series request",
        ),
    ]
    step: Annotated[
        str,
        Query(
            description="Time step across which items/granules will be aggregated, expressed as [ISO 8601 duration](https://en.wikipedia.org/wiki/ISO_8601#Durations)"
        ),
    ]
    step_idx: Annotated[
        int | None,
        Query(description="Optional (zero-indexed) index of the desired time step"),
    ] = None

# titiler/timeseries/factory.py
@dataclass
class TimeSeriesMixin:
    timeseries_dependency: Type[DefaultDependency] = TimeSeriesParams

Then in a titiler.cmr app you could add timeseries functionality like this:
@dataclass
class TimeSeriesEndpoints(Endpoints, TimeSeriesMixin):
    def register_routes(self) -> None:
        self._tiles_routes()
        self._tilejson_routes()
        self._statistics_routes()

    def _tile_routes(self):  # noqa: C901
        """Register tileset endpoints."""

        @self.router.get(
            "/tiles/{step_idx}/{tileMatrixSetId}/{z}/{x}/{y}",
            **img_endpoint_params,
            tags=["Raster Tiles"],
        )
        @self.router.get(
            "/tiles/{step_idx}/{tileMatrixSetId}/{z}/{x}/{y}.{format}",
            **img_endpoint_params,
            tags=["Raster Tiles"],
        )
        @self.router.get(
            "/tiles/{step_idx}/{tileMatrixSetId}/{z}/{x}/{y}@{scale}x",
            **img_endpoint_params,
            tags=["Raster Tiles"],
        )
        @self.router.get(
<EMAIL_ADDRESS>            **img_endpoint_params,
            tags=["Raster Tiles"],
        )
        def tiles_endpoint(
            request: Request,
            tileMatrixSetId: Annotated[
                Literal[tuple(self.supported_tms.list())],
                Path(description="Identifier for a supported TileMatrixSet"),
            ],
            z: Annotated[
                int,
                Path(
                    description="Identifier (Z) selecting one of the scales defined in the TileMatrixSet and representing the scaleDenominator the tile.",
                ),
            ],
            x: Annotated[
                int,
                Path(
                    description="Column (X) index of the tile on the selected TileMatrix. It cannot exceed the MatrixHeight-1 for the selected TileMatrix.",
                ),
            ],
            y: Annotated[
                int,
                Path(
                    description="Row (Y) index of the tile on the selected TileMatrix. It cannot exceed the MatrixWidth-1 for the selected TileMatrix.",
                ),
            ],
            scale: Annotated[  # type: ignore
                conint(gt=0, le=4), "Tile size scale. 1=256x256, 2=512x512..."
            ] = 1,
            format: Annotated[
                ImageType,
                "Default will be automatically defined if the output image needs a mask (png) or not (jpeg).",
            ] = None,
            ###################################################################
            # CMR options
            query=Depends(cmr_query),
            ###################################################################
            backend: Annotated[
                Literal["rasterio", "xarray"],
                Query(description="Backend to read the CMR dataset"),
            ] = "rasterio",
            ###################################################################
            # ZarrReader Options
            ###################################################################
            variable: Annotated[
                Optional[str],
                Query(description="Xarray Variable"),
            ] = None,
            drop_dim: Annotated[
                Optional[str],
                Query(description="Dimension to drop"),
            ] = None,
            time_slice: Annotated[
                Optional[str], Query(description="Slice of time to read (if available)")
            ] = None,
            decode_times: Annotated[
                Optional[bool],
                Query(
                    title="decode_times",
                    description="Whether to decode times",
                ),
            ] = None,
            ###################################################################
            # Rasterio Reader Options
            ###################################################################
            indexes: Annotated[
                Optional[List[int]],
                Query(
                    title="Band indexes",
                    alias="bidx",
                    description="Dataset band indexes",
                ),
            ] = None,
            expression: Annotated[
                Optional[str],
                Query(
                    title="Band Math expression",
                    description="rio-tiler's band math expression",
                ),
            ] = None,
            bands: Annotated[
                Optional[List[str]],
                Query(
                    title="Band names",
                    description="Band names.",
                ),
            ] = None,
            bands_regex: Annotated[
                Optional[str],
                Query(
                    title="Regex expression to parse dataset links",
                    description="Regex expression to parse dataset links.",
                ),
            ] = None,
            unscale: Annotated[
                Optional[bool],
                Query(
                    title="Apply internal Scale/Offset",
                    description="Apply internal Scale/Offset. Defaults to `False`.",
                ),
            ] = None,
            resampling_method: Annotated[
                Optional[RIOResampling],
                Query(
                    alias="resampling",
                    description="RasterIO resampling algorithm. Defaults to `nearest`.",
                ),
            ] = None,
            ###################################################################
            # Reader options
            ###################################################################
            nodata: Annotated[
                Optional[Union[str, int, float]],
                Query(
                    title="Nodata value",
                    description="Overwrite internal Nodata value",
                ),
            ] = None,
            reproject_method: Annotated[
                Optional[WarpResampling],
                Query(
                    alias="reproject",
                    description="WarpKernel resampling algorithm (only used when doing re-projection). Defaults to `nearest`.",
                ),
            ] = None,
            ###################################################################
            # Rendering Options
            ###################################################################
            post_process=Depends(available_algorithms.dependency),
            rescale=Depends(dependencies.RescalingParams),
            color_formula=Depends(dependencies.ColorFormulaParams),
            colormap=Depends(dependencies.ColorMapParams),
            render_params=Depends(dependencies.ImageRenderingParams),
            ###################################################################
            # TimeSeries Options
            ###################################################################
            timeseries_params=Depends(self.timeseries_dependency),
        ) -> Response:
            """Get tile for a particular step in a time series"""

            # convert start_datetime, end_datetime, step, step_idx into a datetime value for the vanilla /tiles endpoint
            # format the url, then forward the request to that url

@hrodmn these look like solid ideas - thank you! One thing I'm not sure I understand is how tiles routes are intended to work / the use case for them. In other words, to date, tiles are usually generated for one time step since all that maps render at one time. I could see a scenario where tiles for multiple time steps are pre-loaded and either displayed at once or based on map datetime parameters. I assume in the example above, you were just demonstrating what the tiles endpoint would look like and there would be a similar but distinct method for statistsics?
Do you think it would be helpful to think through the use cases above before moving this to a design doc - either an ADR to core titiler OR a new repo?

Yeah I'm sorry if I wasn't clear in my comments - I am trying to imagine the larger timeseries API and how it fits into the titiler ecosystem. The /tile idea above was easiest to riff on since the /statistics endpoint doesn't exist in titiler.cmr yet.
I think the /timeseries/tiles endpoints would be useful for building web maps that allow users to browse across time:

Do you think it would be helpful to think through the use cases above before moving this to a design doc - either an ADR to core titiler OR a new repo?
I think I have enough background now to start an ADR but it would be great to get a :+1: / :-1: from @vincentsarago on the idea of a titiler.timeseries repo vs building the time series logic in titiler.cmr for now. I think the feature would be very useful in titiler.pgstac, too, which is why I thought defining the timeseries_params in a common place would be useful.

Great, thanks @hrodmn
@j08lue do you think the API proposed above (specifically get_statistics) would work for zonal statistics? I see a sum is included in the results for each timestep. I guess we should also allow for projection to be a part of the parameters (would it be TileMatrixSet? 🤔 ) so that passing an equal area projection is possible.

@abarciauskas-bgse @j08lue can you point me to existing code where we run multiple /statistics requests and construct timeseries statistics?

This is how the UI makes the calls:
https://github.com/NASA-IMPACT/veda-ui/blob/8967eafe42601574d9d210150cf5cc63240c5957/app/scripts/components/exploration/analysis-data.ts#L197-L218
You can see that in action on https://earth.gov/ghgcenter/exploration - select a layer, draw an AOI, refine the time selection (on the time line bottom panel), kick off the processing -> see the UI make a lot of requests to /statistics

I had a look at the get_statistics API description and example calls above.
There are a bunch of things I do not get, on first-ish look, at least:

So step is used to generate a list of dates like pandas.date_range(start=start, end=end, freq=step, inclusive="both") and we use that to query pgSTAC for items? Do we need to pass explicit datetimes to pgSTAC - could we not query for date>=start_date etc in SQL? Is this only needed so we can use step to request sub-sampled time series?
Will there be support for more complex geometries than bbox?
Why does the time series endpoint need to know whether data is categorical? 🤔

Happy to talk through these and other design questions in a quick call one of the next days, if that is easier.

Thanks for your feedback @j08lue! I didn't mean for the toy example to be too prescriptive for the eventual API, I just wanted to play around with the idea of assembling results from a bunch of async requests. I am working on a more mature spec in an ADR in the veda-architecture repo and will share it with you soon!

So step is used to generate a list of dates like pandas.date_range(start=start, end=end, freq=step, inclusive="both") and we use that to query pgSTAC for items? Do we need to pass explicit datetimes to pgSTAC - could we not query for date>=start_date etc in SQL? Is this only needed so we can use step to request sub-sampled time series?

step is how you would set the temporal resolution of the time series analysis. I was thinking about this in the context of data sources that would need require multiple items to be mosaiced in time/space to get full coverage for an AOI over a particular window in time. e.g. weekly time series of NDVI from HLS imagery would require that you combine images from different days to get full coverage of your AOI if it spans multiple Landsat/Sentinel orbits. You could accomplish this by registering a pgstac search for the min/max from a particular datetime interval.
For temporally discrete datasets like modeled CO2 emissions step might just determine the frequency of your sample from the datacube.

Will there be support for more complex geometries than bbox?

Yes! titiler.pgstac's /statistics endpoint will accept a geojson in a POST request, there is no reason we couldn't do the same in titiler.cmr. I just used bbox in the POC to keep it simple.

Why does the time series endpoint need to know whether data is categorical? 🤔

This was just relevant to my toy example, I think, but the /timeseries endpoints would have all of the parameters that the upstream endpoints (e.g. /statistics) have. The categorical parameter in the titiler.pgstac /statistics endpoint is really useful for getting pixel counts for categorical data like land cover classifications.

Do I understand correctly that a deployed TiTiler(-pgSTAC) will basically call <my hostname>/statistics via HTTP? Can we not use the internal (Python) statistics API instead?

Calling over HTTP would be useful because we could scale the time series analysis using the Lambda function and have the initial request wait for the lower-level API calls to complete and return it all to the user. I haven't built something like that before but I think it could work. If we did all of the work within a single Lambda call we could bump into timeout or memory issues.

Happy to talk through these and other design questions in a quick call one of the next days, if that is easier.

Yes it would be great to chat some more about these ideas. I'm OOO on Friday 9/27 then at Kiribati Pod Week and SatCamp next week but maybe we could chat on Monday sometime.

@hrodmn happy to jump on a call to talk a bit much on this.

I think I have enough background now to start an ADR but it would be great to get a 👍 / 👎 from @vincentsarago on the idea of a titiler.timeseries repo vs building the time series logic in titiler.cmr for now. I think the feature would be very useful in titiler.pgstac, too, which is why I thought defining the timeseries_params in a common place would be useful.

I would prefer if we can generalize things or make it in titiler.cmr

PR for an ADR is open over here: https://github.com/NASA-IMPACT/veda-architecture/pull/503

Closing as discussion has moved to ADR

Decision on implementation in TiTiler has been made. Is the API specification still open?
A possible model for a time series extraction API would be OGC API - Environmental Data Retrieval
Please refer me to a new ticket on API design, if there is any.

Decision on implementation in TiTiler has been made. Is the API specification still open?

Yes! I have worked out a first draft of a timeseries API and deployed it to the titiler-cmr-staging, but I would like to get some more feedback and test it out on some more datasets. I assume there will be a few iterations, though the API only consists of a single required parameter (datetime) and two optional parameters (step and temporal_mode).
Here is a notebook that demonstrates how to use the /timeseries family of endpoints.
Here are the definitions of the new query parameters: https://github.com/developmentseed/titiler-cmr/blob/77f8336fdc9af00af2725e53f836a8aae4171047/titiler/cmr/timeseries.py#L111-L148

Please refer me to a new ticket on API design, if there is any.

I'll open a new ticket where we can discuss the next steps for the API

Thank you @j08lue @hrodmn - I think we should consider how to iterate on the API design to support interoperability.


Dataset availability

Hi,
I am wondering is there any parts of the dataset that are open to the public?

Hi,
Thanks for the interest in our work.
We provide two rallies for case studies in this repo. We are also plan to release partial dataset in ShuttleNet repo.

We provide two rallies for case studies in this repo.

May I know the column, aroundhead is empty due to what reason? and if possible, could you explain more about how is it obtained?
Thank you!

We are also plan to release partial dataset in ShuttleNet repo.

Great to hear this. Thanks!

Hi,
aroundhead means the player hits the shot around-the-head. You can refer to this video for more details since it is too hard to explain in words. All of the dataset was manually labeled by domain experts.
If you have any questions, please feel free to ask me. Thanks for the interest again :)!

P.S. In men's singles, hit around-the-head is not quite common than women's singles. It will be 1 if the shot is hit around-the-head.

Great, thanks for the clarification!
Last question before closing this issue. In the paper:

We use one of the players (denoted as Player B, and his opponents, denoted as Player A) in our dataset as the target player to predict his rally performances. Specifically, his winning rallies are labeled as positive, while the remaining losing rallies are labeled as negative.

Are the dataset limited to only 2 of the same male players?

Are the dataset limited to only 2 of the same male players?

No, his opponents are not the same player. For example, the target player denoted as Player B may encounter C, D, E. These three players are denoted as Player A in our paper, which is his opponents.

For example, the target player denoted as Player B may encounter C, D, E. These three players are denoted as Player A in our paper, which is his opponents.

If I understand it right, this target player is always Player B? What are the criteria in selecting this target player? Would it affects your Bi- GRU if the whole dataset does not follow such order?
Another question, how do you guys handle the different lengths of rallies in your Bi-GRU. Maybe, I miss out on the paper, perhaps could you point out if it is written in the paper?

If I understand it right, this target player is always Player B?

Yes.

What are the criteria in selecting this target player?

We collected the matches based on the specific player due to the cooperation. We have more matches now and the extended paper is under review now.

Would it affects your Bi- GRU if the whole dataset does not follow such order?

Sorry, I am not sure the meaning of this.

how do you guys handle the different lengths of rallies in your Bi-GRU

We pad all sequences to the max sequence length with zeros.

Hi, sorry for the late response.

Would it affects your Bi- GRU if the whole dataset does not follow such order?
Sorry, I am not sure the meaning of this.

Let's say Player B does not stick to a specific player like what has been done in this published paper, would the Bi-GRU still perform with the same accuracy?

Hi, sorry for the late reply.

Would the Bi-GRU still perform with the same accuracy?

Yes, according our extended results.
BTW, we have released one match as the public dataset. You can refer in ShuttleNet/data/

BTW, we have released one match as the public dataset. You can refer in ShuttleNet/data/

whoa impressive. let me look into it, thanks!


[Proposal] Remove Support for Vue Loader 15

Which means we don't support Vue 2 + Webpack anymore.
Feel free to give suggestions

Won't do recently.


Fixes to scanpy tutorial

Fixes a clustering parameter which changed the default action during upgrade
Version tool fixes

I need to add the new workflow too

thanks @mtekman!


Create more emit events for the masm procedures

This PR adds new emit events for set_item and set_map_item procedures to be able to emit them before and after validation.
TODO:

[ ] update changelog

Related issue: https://github.com/0xPolygonMiden/miden-base/issues/564

Oh - and also let's update the changelog.


[BUG rancher/vsphere-charts] Missing the CSI Snapshotter sidecar - blockSnapshots will never work

vSphere Server Info

vSphere version: 7.0.3

Rancher Server Setup

Rancher version: 2.7.3

Information about the Cluster

Kubernetes version: 1.25.7 RKE2

Describe the bug
RKE2 has added the snapshot controllers and vSphere CSI supports VolumeSnapshots. In fact, this chart added a feature flag to add support here however it seems like it was forgotten that the CSI Snapshotter sidecar is required, as per VMware's installation instructions: https://raw.githubusercontent.com/kubernetes-sigs/vsphere-csi-driver/v2.4.0/manifests/vanilla/deploy-csi-snapshot-components.sh
Notice they apply the following patch:
# Update the vSphere CSI driver to add the snapshot side car.
tmpdir=$(mktemp -d)
echo "creating patch file in tmpdir ${tmpdir}"
cat <<EOF >> "${tmpdir}"/patch.yaml
spec:
  template:
    spec:
      containers:
        - name: csi-snapshotter
          image: 'k8s.gcr.io/sig-storage/csi-snapshotter:${release}'
          args:
            - '--v=4'
            - '--timeout=300s'
            - '--csi-address=\$(ADDRESS)'
            - '--leader-election'
          env:
            - name: ADDRESS
              value: /csi/csi.sock
          volumeMounts:
            - mountPath: /csi
              name: socket-dir
EOF

echo -e "Patching vSphere CSI driver.."
kubectl patch deployment vsphere-csi-controller -n vmware-system-csi --patch "$(cat "${tmpdir}"/patch.yaml)"
echo -e "✅ Successfully patched vSphere CSI driver, please wait till deployment is updated.."
echo -e "\n✅ Successfully deployed all components for CSI Snapshot feature.\n"

To Reproduce
Create a VolumeSnapshotDriver and a VolumeSnapshot with blockSnapshots enabled. You will notice that the snapshot will never complete.
Expected Result
The snapshot should complete and the CSI Snapshotter should be added as a sidecar

This bug fix will also need to be backported to the vSphere charts for the next Rancher 2.7.x release.

@braunsonm Hello!
I  was unable to reproduce this issue.
We do have the csi-snapshotter versions required to create a snapshot packaged in the CSI chart https://github.com/rancher/image-mirror/blob/7a302ecb3ee8740db74de5129e228bf377331b87/images-list#L1396-L1398 and creating a snapshot does work on the latest Rancher 2.7, but it's a lot of manual labor. I had to deploy the additional snapshot components myself, create a PVC, a snapshotStorageClass and a volumeSnapshot.
Repro steps / workaround
To create a snapshot

Deploy an RKE cluster with cloud-provider=vsphere
Configure the vSphere host / datacenter / cloud credentials in the Addon Config tab (same as what would be in your helm install values.yaml)
Add the following in the Addon Config tab

blockVolumeSnapshot:
  enabled: true

Create the cluster
Add the additional snapshot components

./deploy-csi-snapshot-components.sh --kubeconfig <kubeconfig>

Follow the VMware docs https://docs.vmware.com/en/VMware-vSphere-Container-Storage-Plug-in/3.0/vmware-vsphere-csp-getting-started/GUID-E0B41C69-7EEB-450F-A73D-5FD2FF39E891.html to create a PVC, VolumeStorageClass, and VolumeSnapshot.
You can create a default PVC using the storage class Rancher created for you via the UI if you want. I deployed my VolumeStorageClass and VolumeSnapshot via kubectl. All these should complete successfully.
I agree that the CSI snapshotted sidecar logic should be packaged into the chart and this process more automated so customers don't get frustrated.
Notes
For an RKE2 cluster, this contributor is correct https://github.com/rancher/vsphere-charts/issues/50#issuecomment-1600705099. When auto installing the vSphere charts via setting cloud-provider=vsphere during provisioning, Rancher creates a StorageClass for you by default

but not a VolumeStorageClass. You must deploy this yourself right now to create a snapshot.

Notes
For an RKE2 cluster, this contributor is correct https://github.com/rancher/vsphere-charts/issues/50#issuecomment-1600705099. When auto installing the vSphere charts via setting cloud-provider=vsphere during provisioning, Rancher creates a StorageClass for you by default

but not a VolumeStorageClass. You must deploy this yourself right now to create a snapshot.

@a-blender I think the point of this issue is for the snapshotter to be included with the vSphere chart. I'm not doubting it can be done when the snapshotter is deployed.

@braunsonm Oh, based on the repro steps I thought you were having an issue with a snapshot getting stuck after you deployed the snapshotted components manually. This is expected behavior then and will be logged as an enhancement for Rancher 2.8.x.

I've dug into possible workarounds a bit and I doubt that running deploy-csi-snapshot-components.sh from vmware is safe on RKE2.
The script (i've looked at the one tagged from 3.0.2) looks for a deployment snapshot-controller and installs it if missing, but rke2 already has the snapshot-controller (called rke2-snapshot-controller).
This might result in two snapshot controllers getting installed (and 2 validation webhooks too).
I did not yet run this against a test cluster, i just read the script.
So in fact only the patch part of the script is needed. And you still need to carefully check if a cluster upgrade does not remove the new sidecar (helms 3-way merge should leave it though) or leave it on a non-matching version.

Tested this fix on RKE2 and it works as intended however a chart update is required for the fix to be observed on RKE2. Moving this to blocked while waiting for the default CSI chart to be updated on the RKE2 side.

Validated this against v2.9-head https://github.com/rancher/rancher/commit/98d8b8975948ce5929e38e8603950ceb223349de See details below:
ENVIRONMENT DETAILS

Rancher install: Docker
Rancher version: v2.9-head https://github.com/rancher/rancher/commit/98d8b8975948ce5929e38e8603950ceb223349de

TEST RESULT

#
Scenario
Test Case
Result

1
Add snapshotter sidecar to CSI chart w/blockSnapshots enabled
Provision RKE2 downstream node driver cluster,  install vSphere CSI chart with blockSnapshots enabled, install CSI snapshot components
:white_check_mark:

2
Upgrade CSI chart w/blockSnapshots already enabled
Provision RKE2 downstream node driver cluster,  install second highest vSphere CSI chart with blockSnapshots enabled, install CSI snapshot components, upgrade vSphere CSI chart to latest
:white_check_mark:

VALIDATION STEPS
Scenario 1

As a standard user, provisioned a downstream RKE2 v1.28.9+rke2r1 node driver cluster (1 etcd, 1 cp, 1 worker).
Installed vSphere CSI chart (104.0.0+up3.1.2-rancher4) and ensured that blockSnapshots is enabled.
On a client machine with the cluster's kubeconfig, ran this script.
Validated the script was successful and that deployment vsphere-csi-controller has csi-snapshotter as a sidecar.

Scenario 2

Repeated scenario 1, but installed vSphere CSI chart version 103.1.0+up3.1.2-rancher1.
Upgraded chart version to latest version 104.0.0+up3.1.2-rancher4; this was successful.
Validated that the deployment vsphere-csi-controller is still Active.


the folder icons in "Bookmarks" overlap with the file names

After Obsidian v1.3.3 update, the file tree is indented and the folder icons in "Bookmarks" overlap with the file names...

I had the same problem

This should be fixed in 2.0.2.


peer-to-peer code review

Good design.
Good code so far, easy to read.
Classes are descriptive.
Commits are organized, but maybe you can try to be more descriptive and add more for each implementation 😄 .
You can also try having all the images in one folder, so the files can look more organized.

This is my review of this project. 👎
High Lights 💯

[x] Good commit messages.
[x] Descriptive READme file.
[x] No linters errors.
[x] Beautiful UI.
[x] Nice design.
[x] Good code organization.

Optional Suggestions 🔢

[x] It would be better if you make a pull request more descriptive  👌😊


[CU-8686ekeny] Prevents sending uncovered resources to scheduler

Task linked: CU-8686ekeny Add "can generate" check to Create Generation Request endpoint


Pip install for 1.2.1 keeps using drupal 1.6

Docs say Modoboa 1.2.1 (current version) needs drupal 1.7+, but the pip install always insists on and downloads drupal 1.6. This leads to inconsistencies in the current installation experience, and sometime outright errors.
My python version is 2.7.6.

Drupal ? :)
The documentation you're watching (with /en/latest/ inside the address) in the one built from the master branch which requires Django 1.7.
If you want to read the documentation of the 1.2.x branch (which requires Django 1.6):
http://modoboa.readthedocs.org/en/1.2.0/

Sorry I meant django 1.7 :)
It's been a coffeeless morning.

It might also be best to specify which versions of postfix and dovecot too, because I do not see any
/etc/postfix/sql-aliases.cf or /etc/postfix/sql-mailboxes-self-aliases.cf or any of that.


DynamicMap Overlay style ordering

In HoloViews we compute a global ordering of the layers in an Overlay, which is what determines color (and other style ) cycles and the zorder. This is no problem if we know all the frames that will be plotted because we can iterate over all of them to determine the global order. However when plotting a DynamicMap we only know the ordering for all the layers that have been plotted up to that point, which means we cannot determine a consistent global ordering.
The way I see it we have two options:

We can maintain a global ordering that gets expanded when a DynamicMap returns a new layer. This means that color cycles can change because a frame that is requested could have a lower position in the global ordering than what was plotted in previous frames, shifting the previous order along and potentially changing the colors when you return to a previously plotted frame.

We compute the initial global ordering and then simply append to it such that new layers are always given a position in the global ordering that is higher than that of all layers that came before it. The problem with this approach is that the color cycle is basically determined by the order in which you scrub through the space.

These are very subtle issues which will only affect fairly limited use cases, but we have to decide on a consistent policy about this. I'd favor option 1) because it seems more correct and will converge to the correct global ordering as you explore more of the space, but it's still not without its issues.

Very good questions.  Sounds to me like we'll just need to pick one option and document it, whichever one is least unpalatable.

I think I favor option 1. as well. Anyone thinking about what DynamicMap means will realize that there is an issue using color cycles and introducing overlays with more curves later on.
Is the ordering determined from the elements in the DynamicMap cache? I also think we need to be careful about holding onto state that is supposed to be dynamic.

Is the ordering determined from the elements in the DynamicMap cache? I also think we need to be careful about holding onto state that is supposed to be dynamic.

Yes, the best it can do is work out the global ordering given all the information it has at that point. At least with option 1) it will correctly reflect that, rather than being completely dependent on the sequence of previous states.

This is done.


Add labels to Readme.md

Add the following -

Maintained?
PRs allowed?
OpenSource
Contributions
Number of issues
Number of forks
Discord Chat
License

Some References:-

Be creative and add as many useful fields as you want

I am a gssoc participant. I like to work on this issue. Please assign it to me

Assigned @EANimesha !!


NIFI-10760 Add Api key authentication option to ElasticSearchClientServiceImpl

Summary
NIFI-10760
Tracking
Please complete the following tracking steps prior to pull request creation.
Issue Tracking

[x] Apache NiFi Jira issue created

Pull Request Tracking

[x] Pull Request title starts with Apache NiFi Jira issue number, such as NIFI-00000
[x] Pull Request commit message starts with Apache NiFi Jira issue number, as such NIFI-00000

Pull Request Formatting

[x] Pull Request based on current revision of the main branch
[x] Pull Request refers to a feature branch with one commit containing changes

Verification
Please indicate the verification steps performed prior to pull request creation.
Build

[x] Build completed using mvn clean install -P contrib-check

[x] JDK 8
[ ] JDK 11
[ ] JDK 17

Licensing

[ ] New dependencies are compatible with the Apache License 2.0 according to the License Policy
[ ] New dependencies are documented in applicable LICENSE and NOTICE files

Documentation

[ ] Documentation formatting appears as expected in rendered files

need to force push because of the conflict

Thank you for the reviews @exceptionfactory and @ChrisSamo632!
I tried to address your comments, please check my followup commits and comments.

Thanks for making the adjustments @nandorsoma, the current version looks good!
Do you have any additional feedback @ChrisSamo632? It sounds like there are some possibilities for follow-on improvements, but the current version looks ready.

If the remaining suggestions are captured as follow-on tickets (so we don't forget them), I've no objection to these change being Approved & merged

Hey @exceptionfactory, @ChrisSamo632!
Thank you for the reviews.
Follow up Jiras (I didn't add NONE as a separate one, but mentioned it in the PKI one):
NIFI-10775 - Improve support for DescribedValue in PropertyDescriptor.Builder
NIFI-10776 - Add support for PKI Authentication in ElasticSearchClientServiceImpl
NIFI-10777 - Add support for JWT Authentication in ElasticSeachClientServiceImpl
NIFI-10778 - Add support for Kerberos Authentication in ElasticSearchClientServiceImpl

Thanks for the confirmation @ChrisSamo632!
Thanks for the work on this @nandorsoma, and for writing up the follow-on issues!
+1 merging


Merlin's Crystal fix Lady of the Lake step

Fixes #425
Note that I have not tested this because I don't have any available alts atm, but this should fix WidgetTextRequirement not triggering when the dialogue box shows.
Having a look at Runelite's consts here I suspect it's because the child ID is 5 when it's supposed to be 6 for the player's dialogue text.

This is still an issue (for me at least), I went to the location where she was but didn't have a step to talk to her so I moved on without talking to her. Then it told me to spawn the beggar at the door and he wouldn't spawn.

This is still an issue (for me at least), I went to the location where she was but didn't have a step to talk to her so I moved on without talking to her. Then it told me to spawn the beggar at the door and he wouldn't spawn.
version 4.2.1

Was this in Leagues or the main game?
Some Leagues NPCs have new IDs, causing something that works in the main game to not work.


Make Heroku Button name more specific

Clarifies that this is the Broadcast example so you can tell it apart from the Peer example

This will make it more clear on https://elements.heroku.com/addons/cine which Node examples you can click to try out

Thanks!


water_heater.set_temperature error

Describe the bug
Trying to create automation to control water_heater during holiday mode. For that I'm using water_heater.set_temperature service. Whenever I call this service error occur:
2020-06-24 14:09:53 ERROR (MainThread) [bosch_thermostat_client.circuits.ivt_circuit] Setting temperature not allowed in this mode. Temperature is probably out of range MIN-MAX!

water_heater behave strange .. sometimes it sets temperature, sometime not, cant' really reproduce it.
The only time when temperature it being set is when indeed my set i within min_temp - max_temp threshold but those are changing somehow automatically and I see no way how to change it.
during tests I saw even min_temp and max_temp set to 0 ! ... don't know how. It has been reverted back when I changed operation_mode from heat_pump into performance (or vice versa)
Expected behavior
temperature to be set as desire
screenshots
before service call:

Service call:

Version

HA version:  0.111.4
HA Bosch component version: latest
Python Bosch HTTP client version: 0.9.0
wall regulator: Logamatic RC310FA
internet gateway: KM200  (finrware ver 04.06.07)
integration config: IVT -> HTTP

** Debug SCAN **
https://jsonblob.com/0cd2e7f1-b60d-11ea-add9-3fec6e3ef106
Additional context
in general seems like operation_modes are not in line what my KM200 is been able to set. When I change operation_mode in the component to heat_pump, than in the Buderus app I see message: "Can't show current working mode as this mode is not supported by application" ... On the other hand when I set in the app "auto" or "manual" or "off" mode it is showed in the component as "heat_pump" all the time despite what I've set in the app.

Thanks for feedback.
What temperature are you trying to set?
I'll start from the end because it is interesting and if modes are wrongly recognized than setting temperature can't work.
DHW program heat_pump is bosch program HCprogram and as far as I know it is not supported by the app.
It suppose to follow HC1 program and in this program setting temperature is forbidden by KM200.
Can you make more scans?

switch to heat pump and see this messages in buderus app and wait 5 minutes -> make scan
switch in app to auto and wait 5 minutes -> make scan
switch in Home Assistant operation mode to performance, wait 1 minute and make scan.

What temperature are you trying to set?

15°C .. idea behind is to automate "holiday mode". As away_mode is not supported (at least this is what I got as an error when tried to run water_heater.set_away_mode:
2020-06-24 18:15:17 ERROR (MainThread) [homeassistant.components.websocket_api.http.connection.140283686289808]
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/websocket_api/commands.py", line 130, in handle_call_service
    connection.context(msg),
  File "/usr/src/homeassistant/homeassistant/core.py", line 1260, in async_call
    task.result()
  File "/usr/src/homeassistant/homeassistant/core.py", line 1295, in _execute_service
    await handler.func(service_call)
  File "/usr/src/homeassistant/homeassistant/helpers/entity_component.py", line 209, in handle_service
    self._platforms.values(), func, call, required_features
  File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 454, in entity_service_call
    future.result()  # pop exception if have
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 597, in async_request_call
    await coro
  File "/usr/src/homeassistant/homeassistant/helpers/service.py", line 485, in _handle_entity_call
    await result
  File "/usr/src/homeassistant/homeassistant/components/water_heater/__init__.py", line 303, in async_service_away_mode
    await entity.async_turn_away_mode_on()
  File "/usr/src/homeassistant/homeassistant/components/water_heater/__init__.py", line 270, in async_turn_away_mode_on
    await self.hass.async_add_executor_job(self.turn_away_mode_on)
  File "/usr/local/lib/python3.7/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/src/homeassistant/homeassistant/components/water_heater/__init__.py", line 266, in turn_away_mode_on
    raise NotImplementedError()
NotImplementedError

So, I figured out that the simplest way will be to set water_heater to really low (but still safe) temperature during my vacations :) 15°C seems to be good enough in order to not let water frozen during winter time :) and not to high that I could not effort to during a summer :-)

more scans:

switch to heat pump and see this messages in buderus app and wait 5 minutes -> make scan

https://jsonblob.com/38327e80-b630-11ea-add9-7375f0d4368c

switch in app to auto and wait 5 minutes -> make scan

https://jsonblob.com/4b572bf6-b634-11ea-add9-cfb92616b9f4.

switch in Home Assistant operation mode to performance, wait 1 minute and make scan.

https://jsonblob.com/c38e8353-b635-11ea-add9-5975ec06a8e5
this time water_heater behaved differently ... when switched to performance, it is sets to 15°C (one of my previous service calls from earlier today when got errors) and in the entity itself I can change temperature manually. Previously, whenever I changed to performance mode , temperature field in water_heater been diapering.
in the app this is still "auto" (from previous step) but to be honest I do not know what is a difference between "performance" and "heat_pump"
after this step this is how I see water_heater state:

please notice min/max tems .. they have changed (don't know how and why) compering what we had in the morning (see my first post)
Further I notice this new error in the log ... but I'm not sure after each of the steps above ... looking at the time it si most probably just after second scan
2020-06-24 17:34:03 ERROR (MainThread) [bosch_thermostat_client.encryption.base_encryption] Unable to decrypt: b'U0\'\xb1\x1a1\x9d\xbbr\xc6\xbf\xf8S\x8f\xc0f\xcdy\xa2;\xe4d\xbe\x0e\xfd\xb3\x11\x9b\xf8\xa9\x85*\x83\x9e\x8f\xf1Q\x83\xa2\xd2\xcd\'\x8a\xb5\t\xbb\xcd\x0cG\xd8ko\xbc\x17\xe8\x89\xcab\xf1\x96 \xbd\xeba\x10\x9f\xf8\xde{\xf2a\xd3\xff\x90\xe0-<\xcb\xb5\x17\xec\x11\xde)\xf5\x14\xb3\x056\x98\x94\x04\xc8\xf3!/E=\n\xa5\xad8\xce")\xc1=\x13\x19Y)\x80;\xcc\xe2k\xbaG\xeaDkgz\t\xb8D\xe7\xb0_Jd\x87\xc7\x03\x1aP<;\x01\x9b\x1e~\xcf\xf6\x95\xdaU\xe0\r)k\x0c?\x903\x99\xa1@\\\xa6 \x8f\xa9v\xc8\x03\x047\x89\xd8-\rKSY\xcdf\x18\xb1\xa3\xde\xe7\xcb\x17\x1b\x7f:\x0bM\xf9\xc3\xfd\xe3bAg\x93\x92\xe7\xde\xee\x8f\x95\xc4,v\xb8\x06\\\x1a\xe0\xc9\x04wg\\\\9\xd7x\x9c\x93\xb5\x0e' with error: 'utf-8' codec can't decode byte 0xb1 in position 3: invalid start byte

About holiday mode, I tried to implement it, but home assistant doesn't have anything like scheduler/calendar and for bosch holiday mode is like different virtual device, which in fact just change operation mode of DHW to off.
In HC there is something called suWi (which I'm also in progress of adding) and it just make sure that your system wouldn't freeze. I don't know how it works for DHW.
I will study your json's this weekend.
About unable to decrypt, it is normal in debug scan to have these messages, some of URI's are impossible to decrypt.

thank you so much in advance :) ... just to add one more scan :)
Right now we are at "night" mode set automatically by my schedule in the Buderus itself.
water_heater looks like this:

pls note min/max temps and setpoint
scan result:  https://jsonblob.com/38c0b9d4-b668-11ea-add9-13f1f3699464
in the app I see mode "auto" but instead of temperature there is "off"

@pszafer any findings ? :)

for now I'm trying to add sensors from all circuits to HA. just don't have enough time lately :/


Eddy discards lines

From @martinwicke on February 25, 2015 1:58
This is the same problem as #24, but a more nefarious manifestation:
    print "usage: accessDB stats|full <file>\n" +
          "Gets eddy usage data from dynamoDB and stores it in <file>.\n" +
          "  stats : get install IDs and times from the stats index and store as CSV\n" +
          "  full  : get all data and store as JSON. There's an additional guarantee that\n" +
          "          each row from the DB starts at a newline, and all rows except the first\n" +
          "          and last line are DB rows."

turns into
System.out.print("usage: accessDB stats|full <file>\n");

Which would be sort of ok, if it didn't delete the rest.
Copied from original issue: eddysystems/secret#152

From @martinwicke on March 2, 2015 3:23
I like a generic penalty for just dropping stuff. Typically if people write
things there's a reason. The bar should be pretty high for each token
ignored.
On Sunday, March 1, 2015, Geoffrey Irving<EMAIL_ADDRESS>wrote:

Partially fixed by ruling out void + String in a693531
https://github.com/eddysystems/eddy/commit/a693531b7a55ec35e1d78b897cc2bf0b826fa140.
We now produce the much more reasonable
com.intellij.testFramework.PlatformTestUtil.print(new String[]{"usage: accessDB stats|full \n"});
That is, we find a version of "print" that returns nonvoid (that one
returns String), then extract the one part of the expression that has side
effects. Maybe fix this by penalizing dropping parts of the expression when
we extract side effects so as to push this bizarre result below the
probability threshold?
—
Reply to this email directly or view it on GitHub
https://github.com/eddysystems/eddy/issues/152#issuecomment-76651358.

From @martinwicke on March 2, 2015 4:5
Let's just leave it open -- it's not in any milestone, right?
Geoffrey Irving wrote:

Okay, a penalty of 0.3 per dropped grammar node easily rules out that
huge expression, but not the one with just one extra string. The
probability is only 0.002593, though. Is that enough to close this
until we tackle it the real way (making print optionally low precedence)?
—
Reply to this email directly or view it on GitHub
https://github.com/eddysystems/eddy/issues/152#issuecomment-76655789.

From @girving on March 2, 2015 3:40
Hmm, I was thinking of a specifically lifting the "effects" function into Scored, and thus specifically penalizing that one spot, but a generic "verify that all tokens show up" would also work and is easy to implement.  Actually, no, it wouldn't work, since we don't track locations for types.  I think I'll stick to lifting effects into Scored.

From @girving on March 2, 2015 2:50
Partially fixed by ruling out void + String in a693531b7a55ec35e1d78b897cc2bf0b826fa140.  We now produce the much more reasonable
com.intellij.testFramework.PlatformTestUtil.print(new String[]{"usage: accessDB stats|full <file>\n"});

That is, we find a version of "print" that returns nonvoid (that one returns String), then extract the one part of the expression that has side effects.  Maybe fix this by penalizing dropping parts of the expression when we extract side effects so as to push this bizarre result below the probability threshold?

From @girving on March 2, 2015 4:2
Okay, a penalty of 0.3 per dropped grammar node easily rules out that huge expression, but not the one with just one extra string.  The probability is only 0.002593, though.  Is that enough to close this until we tackle it the real way (making print optionally low precedence)?

From @girving on March 2, 2015 4:6
I put it in because I thought it was easy, but I'll take it out again.

From @girving on March 2, 2015 4:8
Penalty pushed as b336670af92624663fa5bf1a7fb49a43aefbd9a9.


SpatialTransform bug on Ensemble Classifier

Describe the bug
The SpatialTransform attack does not properly rotate / translate images formatted for an ensemble of Pytorch models. Judging by the outputs, I think somewhere along the line the channels are not being handled correctly. Note, for an ensemble of Keras models, the attack seems to work fine.
To Reproduce
import torch
from torchvision import models

from art.classifiers import PyTorchClassifier, EnsembleClassifier
from art.attacks import SpatialTransformation

# load and preprocess imagenet images
images = load_preprocess_images(...)

resnet18 = models.resnet18(pretrained=True)
alexnet = models.alexnet(pretrained=True)

wrapped_models = []
for model in [resnet18, alexnet]:
    loss = torch.nn.CrossEntropyLoss()
    optimizer = torch.optim.SGD(model.parameters(), .1, momentum=0.9, weight_decay=1e-4)
    wrapped_model = PyTorchClassifier(model=model, loss=loss, optimizer=optimizer, input_shape=(3,224,224), nb_classes=1000)
    wrapped_models.append(wrapped_model)

ensemble = EnsembleClassifier(wrapped_models)
attack = SpatialTransformation(ensemble, max_translation=10, num_translations=5, max_rotation=10, num_rotations=5)
adv_images = attack.generate(x = images)

example input and output images:

Expected behavior
example input and expected output images:

System information (please complete the following information):

Fedora Linux
Python 3.6.7
ART 1.0.1
PyTorch 1.2.0

Hi @dapello Thank you for raising this issue! Do you also observe this unexpected behaviour of SpatialTransformation if you use PyTorchClassifier without EnsembleClassifier?

Hi @beat-buesser, in my experience it only happens with the ensemble of pytorch classifiers -- using a single PyTorchClassifier behaved as expected.

Can you try setting the argument channel_index=1 in EnsembleClassifier?

Ah, that fixed it! Thank you.


VanillaNet x MobileOne

Is there any comparasion or comment with MobileOne?
https://github.com/apple/ml-mobileone

Not yet. I will test it later.


Support customized host?

Is there any plan for supporting customized host on the flask app? I can work around it by ssh ip mapping, but it would be more convenient if the command line interface directly supports it.

Closed due to inactivity.


Multiple "ConsoleDriver.Run"s causes AccessViolationException

Brief Description
Adding two ConsoleDriver.Run() statements in the main function causes AccessViolationException. Keeping either one of them clears the exception.
OS: Windows 10.
Used settings
options.CheckSymbols = true;
Stack trace or incompilable generated code
Fatal error. System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt.
Repeat 2 times:
--------------------------------
   at CppSharp.Parser.ClangParser+__Internal.Build(IntPtr, IntPtr, IntPtr, Boolean)
--------------------------------
   at CppSharp.Parser.ClangParser.Build(CppSharp.Parser.CppParserOptions, CppSharp.Parser.CppLinkerOptions, System.String, Boolean)
   at CppSharp.Passes.GenerateSymbolsPass.GenerateSymbols()
   at CppSharp.Passes.GenerateSymbolsPass.VisitASTContext(CppSharp.AST.ASTContext)
   at CppSharp.Generators.BindingContext.<RunPasses>b__37_0(CppSharp.Passes.TranslationUnitPass)
   at CppSharp.PassBuilder`1[[System.__Canon, System.Private.CoreLib, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].RunPasses(System.Action`1<System.__Canon>)
   at CppSharp.Generators.BindingContext.RunPasses()
   at CppSharp.Driver.ProcessCode()
   at CppSharp.ConsoleDriver.Run(CppSharp.ILibrary)
   at Program.<Main>$(System.String[])

Addressed by adding to modules instead of running two libraries.

Using two modules work but it also means they have to share the same options.
Is there any way to process two libraries in one application?


Zowe Explorer FAQ release notes update

Your checklist for this pull request
🚨Please review the guidelines for contributing to this repository.

[ ] If the changes in this PR is part of the next future release, make this pull request against the docs-staging branch which will be published at the next release boundary. If the changes in this PR are part of the current release, use the default base branch, master. For more information about branches, see https://github.com/zowe/docs-site/tree/master#understanding-the-doc-branches.

[ ] If this PR relates to GitHub issues in docs-site or other repositories, please list in Description, prefixed with close, fix or resolve keywords.

Description (including links to related git issues)
Update Zowe 1.14 Release Notes in the ZE section.
:heart:Thank you!

@IgorCATech It looks like this PR contains all of the 1.14 changes from doc-staging (note that it says "177 Files Changed" in this PR)
Make sure to get all of your changes into doc-staging. Or, if you intend to get something out to Live/Master right now, you'll need to close this PR and open a different one that only contains those changes. LMK if you have any questions


Compose for web tutorial didn't work

Was following https://github.com/JetBrains/compose-jb/tree/master/tutorials/Web/Getting_Started.
Stacktrace:
❯ ./gradlew jsBrowserRun

Welcome to Gradle 7.1!

Here are the highlights of this release:
 - Faster incremental Java compilation
 - Easier source set configuration in the Kotlin DSL

For more details see https://docs.gradle.org/7.1/release-notes.html

Starting a Gradle Daemon, 2 incompatible and 1 stopped Daemons could not be reused, use --status for details

> Configure project :
Kotlin Multiplatform Projects are an Alpha feature. See: https://kotlinlang.org/docs/reference/evolution/components-stability.html. To hide this message, add 'kotlin.mpp.stability.nowarn=true' to the Gradle properties.

> Task :jsBrowserDevelopmentRun FAILED
[webpack-cli] Invalid configuration object. Object has been initialized using a configuration object that does not match the API schema.
 - configuration has an unknown property '_assetEmittingWrittenFiles'. These properties are valid:
   object { bonjour?, client?, compress?, dev?, firewall?, headers?, historyApiFallback?, host?, hot?, http2?, https?, liveReload?, onAfterSetupMiddleware?, onBeforeSetupMiddleware?, onListening?, open?, port?, proxy?, public?, setupExitSignals?, static?, transportMode?, watchFiles? }

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':jsBrowserDevelopmentRun'.
> [webpack-cli] Invalid configuration object. Object has been initialized using a configuration object that does not match the API schema.
   - configuration has an unknown property '_assetEmittingWrittenFiles'. These properties are valid:
     object { bonjour?, client?, compress?, dev?, firewall?, headers?, historyApiFallback?, host?, hot?, http2?, https?, liveReload?, onAfterSetupMiddleware?, onBeforeSetupMiddleware?, onListening?, open?, port?, proxy?, public?, setupExitSignals?, static?, transportMode?, watchFiles? }

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 21s
9 actionable tasks: 6 executed, 3 up-to-date

It seems to be the same issue as https://github.com/JetBrains/compose-jb/issues/1058
Try to see if the WA helps you

Relevant to https://youtrack.jetbrains.com/issue/KT-48273

Hey @dodalovic thanks for reporting! This is caused by an issue in kotlin gradle plugin - luckily there's a workaround - I've temporarily patched all examples so now they are supposed to be working.

Please check the following ticket on YouTrack for follow-ups to this issue. GitHub issues will be closed in the coming weeks.


Is there any recommended api client?

Is there a recommended API client you would suggest? I work more with Node.js, but could not find any client for Node.js. Is there any page with the client libraries connecting to the API?
Thank you for the wonderful package!

I'm starting to write one here https://github.com/yaleman/pfsense-api-client

Update on this. v1.4.0 will make the switch to Swagger/OpenAPI for documentation and structure. This will also include the ability for auto-generated API clients in your desired language.

Any new/updates on API client? Looking to develop an iOS app/client to control pfSense. Would prefer to not reinvent the wheel. Thanks.

Not sure how much it would help for iOS development, but I have a API client created for go at https://github.com/sjafferali/pfsense-api-goclient.


Stirling PDF basic icon

Dont know if you still doing PRs due to rework but putting this here  :')

yeah, you may want to also do a PR into dotnet with this, into the dotnet subdir


[Work in Progress] Plotting out data in Base_GD on consumption vs generation

This pull request adds a new functions file for plotting out the data in Base_GD.csv. It looks at energy consumption vs installed PV system generation, for various companies and tariff systems in place. Each company (CNFL, ICE) gets a new notebook in which graphs are displayed. The regional companies ESPH and JASEC are also included in the data, so they get notebooks as well.
I'm looking for guidance understanding what all the various tariff systems mean, and who they apply to.
Marking this as Work In Progress because this is part of a larger effort to compare Base_GD values to what "economically rational" agents would do, which this is just one step towards.

Since the plots don't preview here, I'll just link the versions on my fork:

CNFL
ICE
ESPH
JASEC

The results look really good, they need to be collected into smaller categories and some 0's should be removed.


Build Error on Windows : fs-admin command failed

While building Atom for local developpement I've got some errors, this one is the first one, can somone explain me how to fix it ?
PS D:\GitHub\atom\atom> node .\script\bootstrap
Node:   v16.7.0
Npm:    v7.20.3
Python: v3.9.0
Installing script dependencies
npm ERR! code 1
npm ERR! path D:\GitHub\atom\atom\script\node_modules\fs-admin
npm ERR! command failed
npm ERR! command C:\WINDOWS\system32\cmd.exe /d /s /c prebuild-install || node-gyp rebuild
npm ERR! (node:9252) [DEP0150] DeprecationWarning: Setting process.config is deprecated. In the future the property will be read-only.
npm ERR! (Use `node --trace-deprecation ...` to show where the warning was created)
npm ERR! gyp: C:\Users\nboud\AppData\Local\node-gyp\Cache\16.7.0\common.gypi not found (cwd: D:\GitHub\atom\atom\script\node_modules\fs-admin) while reading includes of binding.gyp while trying to load binding.gyp
npm ERR! gyp ERR! configure error
npm ERR! gyp ERR! stack Error: `gyp` failed with exit code: 1
npm ERR! gyp ERR! stack     at ChildProcess.onCpExit (D:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\lib\configure.js:351:16)
npm ERR! gyp ERR! stack     at ChildProcess.emit (node:events:394:28)
npm ERR! gyp ERR! stack     at Process.ChildProcess._handle.onexit (node:internal/child_process:290:12)
npm ERR! gyp ERR! System Windows_NT 10.0.19043
npm ERR! gyp ERR! command "D:\\Program Files\\nodejs\\node.exe" "D:\\Program Files\\nodejs\\node_modules\\npm\\node_modules\\node-gyp\\bin\\node-gyp.js" "rebuild"
npm ERR! gyp ERR! cwd D:\GitHub\atom\atom\script\node_modules\fs-admin
npm ERR! gyp ERR! node -v v16.7.0
npm ERR! gyp ERR! node-gyp -v v7.1.2
npm ERR! gyp ERR! not ok

npm ERR!      C:\Users\nboud\AppData\Local\npm-cache\_logs\2021-09-20T20_15_15_948Z-debug.log

Sorry that the error is a bit hard to read.
It is an error while running node-gyp, but probably it means a file wasn't put where it was supposed to be put...
Here is the inner-most error of the larger trace you posted:
npm ERR! gyp: C:\Users\nboud\AppData\Local\node-gyp\Cache\16.7.0\common.gypi not found (cwd: D:\GitHub\atom\atom\script\node_modules\fs-admin) while reading includes of binding.gyp while trying to load binding.gyp

I think that means you are missing a file in node-gyp's cache of files/headers for the version of Node you are building some native code for.
I would suggest to:

cd into [your_atom_repo_dir]\script\node_modules\fs-admin and do npm rebuild.
Or... cd into [your_atom_repo_dir]\script and do npm install --ci.

If neither of those works, do this and then try again:

Delete C:\Users\nboud\AppData\Local\node-gyp\Cache\16.7.0 and do npx node-gyp install
This might be easier: npx node-gyp remove 16.7.0 then npx node-gyp install 16.7.0.

Thank you, I just have made it clean with the last solution first in the node-gyp Cache folder, npx node-gyp remove 16.7.0 then npx node-gyp install 16.7.0
It worked !


Avoid references to legacy services

I think we should avoid references back to legacy services like this: "The node type can be seen as equivalent to roles in Cloud Services"

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 658de695-0927-175f-0419-dcf7b6bece9d
Version Independent ID: 8166322c-774b-9434-3df5-5501b7dd9cf1
Content: Planning the Service Fabric cluster capacity
Content Source: articles/service-fabric/service-fabric-cluster-capacity.md
Service: service-fabric
GitHub Login: @ChackDan
Microsoft Alias: chackdan

Thankyou for the feedback. We have a boat load of tier1 customers who are still on Cloud Services, when they evaluate options to move forward, having such references are a help.
@MicahMcKittrick-MSFT  - please close the issue.


pkg(ticdc): merge package regionspan and spanz

What problem does this PR solve?

Issue Number: ref #7720
What is changed and how it works?
This is a clean up PR, for now there are two span in TiCDC code base. We should unify Span usage to avoid confusing.

Remove regionspan.Span
Replace regionspan.ComparableSpan to tablepb.Span.

Check List
Tests

Unit test
Integration test

Questions
Will it cause performance regression or break compatibility?
No
Do you need to update user documentation, design documentation or monitoring documentation?
No
Release note
None

/run-all-tests

/run-all-tests pd=release-6.5

/run-all-tests

/run-engine-integration-test

/run-engine-integration-test


Create New-TfsWorkspace cmdlet

This command will create a new workspace
Parameters:
Computer
WorkSpaceName
Collection
Permission
See comand tf workspace /new


Order by updated_at on the documents index page

https://trello.com/c/XJRTeF9f/130-spv2-orders-by-the-wrong-timestamp-on-the-search-index
We took the opportunity to refactor some of the things we touched. It is probably better to review this pull request commit by commit as we tried to write explanatory commits.
I have completed some testing locally and things are working. We should do another round on integration once this is merged.
Finally, we broke out some tickets. We felt these were too big to tackle as part of this ticket:
https://trello.com/c/adcEv2QV/134-clean-up-lib-documents-schemas
https://trello.com/c/4ZLEWBdg/136-clean-up-payloads
Depends on this pull request which has been merged:
https://github.com/alphagov/publishing-api/pull/298

💯  all good changes, and a large net reduction in lines of code. I'll merge this, but IMHO next time it'd be better to split the refactoring and the change into 2 PRs.


Are less mainstream languages allowed?

(Asking because I wasn't sure after reading the README) Are solutions in non-mainstream languages (like Clojure, Haskell, etc.) allowed in the Alternate Languages folder?
PS: Sorry if I'm abusing Github Issues, but I wasn't sure where to ask questions. Please let me know if there is a better place to ask questions.

.... And apparently non-mainstream languages are allowed in Alternate Languages. Closing issue since I found my answer.
PS: Still don't know what is the appropriate place to ask questions - please let me know!

Please have a look in the readme. There is also a section on Alternate Languages.

Still don't know what is the appropriate place to ask questions - please let me know!

As long as there are no github dicussions or an active stackoverflow tag for a project it is ok to ask questions in an github issue!

Thanks! @mojoaxel


Better looking initial page loading

This is essentially a task to make initial page rendering smooth.
There is currently no smooth transition between having no data; and having data. When the initial requests are taking place we should display loading indicators etc.. Go nuts.

Done


Google Auth Infinite loading after choose the user

I've try to use default example from extension_google_sign_in_as_googleapis_auth package
When I try to Sign In I see popup with accounts and after I choose account I see window with Infinite loading and nothing more.

How to debug to resolve it?

Can you please provide minimal sample code you are using for this??

Hi @bookin, thanks for filing the issue.
Can you please provide the output of your flutter doctor -v?
Thank you

Hi @zahidshaikh08, I'm using this code without changes.
Hi @danagbemava-nc, it's response:
[✓] Flutter (Channel master, 2.5.0-7.0.pre.80, on Mac OS X 10.15.5 19F101 darwin-x64, locale en-GB)
    • Flutter version 2.5.0-7.0.pre.80 at /Users/anton/Documents/MyApps/Libraries/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 1422bfa723 (9 days ago), 2021-08-14 04:02:06 -0400
    • Engine revision a447901bc5
    • Dart version 2.15.0 (build 2.15.0-15.0.dev)

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.3)
    • Android SDK at /Users/anton/Library/Android/sdk
    • Platform android-30, build-tools 30.0.3
    • Java binary at: /Applications/Android Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.10+0-b96-7281165)
    • All Android licenses accepted.

[!] Xcode - develop for iOS and macOS
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 12.4, Build version 12D4e
    ! CocoaPods 1.9.1 out of date (1.10.0 is recommended).
        CocoaPods is used to retrieve the iOS and macOS platform side's plugin code that responds to your plugin usage on the Dart side.
        Without CocoaPods, plugins will not work on iOS or macOS.
        For more info, see https://flutter.dev/platform-plugins
      To upgrade see https://guides.cocoapods.org/using/getting-started.html#installation for instructions.

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2020.3)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.10+0-b96-7281165)

[✓] VS Code (version 1.47.3)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension can be installed from:
      🔨 https://marketplace.visualstudio.com/items?itemName=Dart-Code.flutter

[✓] Connected device (1 available)
    • Chrome (web) • chrome • web-javascript • Google Chrome 92.0.4515.159

! Doctor found issues in 1 category.

Hi @bookin, using the code in the link that you provided, I am able to login, as such the package works as expected. I tested on master and stable. See attached video.
I suspect that the issue may lie with the google cloud side, so kindly look into the following links and let me know if you're able to resolve your issue.

Oauth consent
setting up oauth consent

sign in .mp4.zip

 flutter doctor -v
[✓] Flutter (Channel master, 2.5.0-7.0.pre.213, on macOS 11.5.1 20G80
    darwin-arm, locale en-GB)
    • Flutter version 2.5.0-7.0.pre.213 at /Users/nexus/dev/sdks/flutters
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 6dc18ef74e (7 hours ago), 2021-08-24 11:09:04 +0530
    • Engine revision 926ce0d855
    • Dart version 2.15.0 (build 2.15.0-43.0.dev)

[✓] Android toolchain - develop for Android devices (Android SDK version 31.0.0)
    • Android SDK at /Users/nexus/Library/Android/sdk
    • Platform android-31, build-tools 31.0.0
    • Java binary at: /Applications/Android
      Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.10+0-b96-7249189)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 12.5.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • CocoaPods version 1.10.2

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2020.3)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.10+0-b96-7249189)

[✓] VS Code (version 1.59.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.25.0

[✓] Connected device (3 available)
    • M2007J20CG (mobile) • 5dd3be00 • android-arm64  • Android 11 (API 30)
    • macOS (desktop)     • macos    • darwin-arm64   • macOS 11.5.1 20G80
      darwin-arm
    • Chrome (web)        • chrome   • web-javascript • Google Chrome
      92.0.4515.159

• No issues found!

[✓] Flutter (Channel stable, 2.2.3, on macOS 11.5.1 20G80 darwin-arm, locale
    en-GB)
    • Flutter version 2.2.3 at /Users/nexus/dev/sdks/flutter
    • Framework revision f4abaa0735 (8 weeks ago), 2021-07-01 12:46:11 -0700
    • Engine revision 241c87ad80
    • Dart version 2.13.4

[✓] Android toolchain - develop for Android devices (Android SDK version 31.0.0)
    • Android SDK at /Users/nexus/Library/Android/sdk
    • Platform android-31, build-tools 31.0.0
    • Java binary at: /Applications/Android
      Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.10+0-b96-7249189)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 12.5.1, Build version 12E507
    • CocoaPods version 1.10.2

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2020.3)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.10+0-b96-7249189)

[✓] VS Code (version 1.59.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.25.0

[✓] Connected device (3 available)
    • M2007J20CG (mobile) • 5dd3be00 • android-arm64  • Android 11 (API 30)
    • macOS (desktop)     • macos    • darwin-arm64   • macOS 11.5.1 20G80
      darwin-arm
    • Chrome (web)        • chrome   • web-javascript • Google Chrome
      92.0.4515.159

• No issues found!

Hi @danagbemava-nc, you're right, the problem was in the Google Console with accounts for app.
Just difficult to understand where the problem is when it doesn't say anything and just shows loading.
Thanks for check and help with it!


[cics] Removed org.fusesource:camel-cics-starter

since there is camel-cics-starter-parent and camel-cics-starter I don't know if also org.fusesource:camel-cics-starter is necessary, am I wrong @cunningt ?

This is needed because of the non-standard groupId, please close this and do not remove.

@cunningt Hi, I do not get it why sap is not needed then


Lightnings don't appear

Yes, it's weird, i don't even know if this is multiverse fault, but it's most likely, So, lightnings don't show up when you do /lightning in any other worlds, they only appear in the original (world, world_nether and world_the_end). If you go to another world and do /lightning you will get damaged and hear the sound but you can't see it, any ideas of what's causing this?

The problem was with essentialsX. Updated it and it was solved


Question : FreSharp for Android

FreSharp is for windows platform only. But is there a similar solution for Android to build Air Native Extensions using C# and Xamarin ?
Thanks, Alex

There is not. and I doublt it is possible to build Air Native Extensions using C# and Xamarin. Xamarin is a completely different platform