Missing molecules from first #n frames of saved trajectory using DCDreporter with OpenMM

When setting up an OpenMM simulation in a Jupyter Notebook to use a DCDReporter to save the trajectory and then reading the recorded trajectory into VMD to visualise it, the molecule is absent from a number of frames at the start of the recording.
This number of frames changes depending on the frequency of frames set in the reporter. For example, when setting the reporter as openmm.DCDReporter('output10x.dcd', 10) (to report every 10 ps), the molecule only appears on frame 70 (the first 69 frames are empty). However, when the reporter is set to openmm.DCDReporter('output10x.dcd', 500), the molecule appears on frame 19.
This issue reoccurs consistently, i.e. with an interval of 10 ps, the molecule always appears on frame 70.
Additionally, it doesn't matter whether you start the simulation before attatching a reporter or vice versa, you always get the same result.
Note that this issue doesn't occur when using the inbuilt functionality of NanoVer to record the trajectory.

Could you share a complete Jupyter notebook that demonstrates this? I'm not too familiar with DCDReporter etc

https://github.com/IRL2/nanover-protocol/blob/main/examples/openmm/openmm_polyalanine.ipynb
I have found out about this problem running 'openmm_polyalanine.ipynb' example, the command is in 10th cell.

Trying to figure this out, I can't even get it to work without using nanover:
Do you have the issue with just running it this way? I think we need a working example from regular OpenMM python that we can compare to. Also, what can I use to check a DCD file?

Trying to figure this out, I can't even get it to work without using nanover:
Do you have the issue with just running it this way? I think we need a working example from regular OpenMM python that we can compare to. Also, what can I use to check a DCD file?

To watch the .dcd file you can use VMD

From working with Ludovica we tried the non-nanover method with no success ("we got more frames and none of them show the alanine"), so it seems either DCDReporter is broken or we don't know how to use it. There's an example here: https://agkeller.userpage.fu-berlin.de/source/intro_openmm/intro_openmm.html that seems to do what we're doing, so I don't see what we could be doing wrong.
import openmm as mm
from openmm import app
from openmm import unit

pdb = app.PDBFile('openmm_files/17-ala.pdb')
forcefield = app.ForceField('amber99sb.xml', 'tip3p.xml')
system = forcefield.createSystem(
    pdb.topology,
    nonbondedMethod=app.PME,
    nonbondedCutoff=1 * unit.nanometer,
    constraints=app.HBonds,
    removeCMMotion=False,
)

integrator = mm.LangevinIntegrator(
    300 * unit.kelvin,
    1 / unit.picosecond,
    0.002 * unit.picoseconds,
)
simulation = app.Simulation(pdb.topology, system, integrator)
simulation.context.setPositions(pdb.positions)

dcd_reporter = app.DCDReporter('output2.dcd', 1)
simulation.reporters.append(dcd_reporter)

simulation.step(1000)

Todo: confirm that the current notebook example definitely doesn't work, then use something else in notebook.

I tested with this and it seems to create DCD files with the correct number of frames. @ludovicaisa could you try running this and check a few of the output files are valid and working? In this example each should have 50 frames. Maybe the file closing is causing the problem in the notebook.
import openmm as mm
from openmm import app
from openmm import unit

def create_sim():
    pdb = app.PDBFile('examples/openmm/openmm_files/17-ala.pdb')
    forcefield = app.ForceField('amber99sb.xml', 'tip3p.xml')
    system = forcefield.createSystem(
        pdb.topology,
        nonbondedMethod=app.PME,
        nonbondedCutoff=1 * unit.nanometer,
        constraints=app.HBonds,
        removeCMMotion=False,
    )

    integrator = mm.LangevinIntegrator(
        300 * unit.kelvin,
        1 / unit.picosecond,
        0.002 * unit.picoseconds,
    )
    simulation = app.Simulation(pdb.topology, system, integrator)
    simulation.context.setPositions(pdb.positions)

    simulation.minimizeEnergy()
    simulation.step(100)

    from nanover.omni.openmm import OpenMMSimulation

    # Create the OpenMMSimulation instance
    polyalanine_simulation = OpenMMSimulation.from_simulation(simulation)

    # Load the simulation
    polyalanine_simulation.load()

    return polyalanine_simulation

from MDAnalysis.lib.formats.libdcd import DCDFile

for i in range(1,50):
    try:
        path = f"output_{i}.dcd"
        dcd_reporter = app.DCDReporter(path, i)

        sim = create_sim()
        sim.simulation.reporters.append(dcd_reporter)
        sim.simulation.step(i * 50)

        dcd_reporter.__del__()

        with DCDFile(path) as dcd:
            print(dcd.n_frames, i)
    except OSError:
        print("FAIL", i)


How do I edit the .stashrc file?

I tried navigating into Python modules but I can’t edit the file because it’s a dot file. I tried using vi or Nano but that didn’t work

Have you tried the edit command?

Thanks. Using that command went over my head lol


Discuss moving to PHP 7.x

So we have already been talking about moving to PHP 7.x, but I was against it so far, because Money 3.x is relatively young and I wanted to avoid maintaining two separate major versions.
That said, I would like to start thinking about the possibility.
I still think that we would have to support 3.x for quite some time and by support I mean backporting features from the 4.x release line whenever possible, which is probably a huge overhead.
I would like to hear some opinion on this matter.

Do it. There is no reason to support php 5 anymore for new releases. Any project staying at 5.x doesn't deserve it ^^
Also consider to use php 7.1 as minimum

I fully support bumping the requirement to 7.1, it brings a lot of benefits. A lot of popular open source frameworks and libraries (Symfony, Laravel, Doctrine etc) are making the switch to 7 or 7.1 in their next major release.
I'd suggest only backporting bug fixes. The current feature set is very strong, so new features are unlikely to be critical to existing projects, and in the cases where they are, upgrading to PHP 7.1 is often quite straightforward.

Cause the active support ends this year and the security next year I also see no reason to create more releases with php5.6 or even lower in mind.
http://php.net/supported-versions.php
For me: every library that, active, supports php5 anymore slow down the acceptanceof php7.

We would love to see a PHP 7.1 version.

Thanks for all the feedback. I would like to concentrate on the 3.1 release ahead of us, but after that I will start working on migrating to PHP 7, probably 7.1
That should let us clear a bunch of docblocks and remove deprecations.


DBT initialization error in CLI ingestion

Describe the bug
When using the below recipe template (in which the metadata paths are working as expected and sink connection is established), I receive an error message as PATH/Python312\site-packages\datahub\ingestion\run\pipeline.py", line 140, in _add_init_error_context
raise PipelineInitError(f"Failed to {step}: {e}") from e
datahub.ingestion.run.pipeline.PipelineInitError: Failed to find a registered source for type dbt: dbt is disabled due to an error in initialization
pipeline_name: "[PIPELINE_NAME]"
source:
type: "dbt"
config:
# Coordinates
manifest_path: "[PATH_TO_MANIFEST.JSON]" #MANIFEST metadata
catalog_path: "[PATH_TO_CATALOG.JSON]" #CATALOG metadata
#sources_path: "[PATH_TO_SOURCES.JSON]" #SOURCES metadata
test_results_path: "[PATH_TO_RESULTS.JSON]" #RESULTS metadata
#only_include_if_in_catalog: true
# Options
target_platform: "bigquery" # e.g. bigquery/postgres/etc.
stateful_ingestion:
  enabled: true
  remove_stale_metadata: false
node_name_pattern:  # allows for inclusion or exclusion of assets for the ingestion via regular expressions
  ignoreCase: true
  allow:
    - .*[]
  deny:
    - .*[]

#Setup connection to datahub env
sink:
type: "datahub-rest"
config:
server: "[LOCALHOST]"
token: "[ACCESS TOKEN]"
To Reproduce
Steps to reproduce the behavior:

Using virtual environment with wheel
Using DataHub CLI version: <IP_ADDRESS>
'acryl-datahub[dbt]' is installed
Run ingestion as: datahub ingest -c [PATH]\dbt_meta_ingest.yaml

Expected behavior
Ingestion Pipeline finished
Screenshots

Desktop (please complete the following information):

OS: WINDOWS 10
Command line: Windows powershell

Additional context
Add any other context about the problem here.

Fixed by https://github.com/datahub-project/datahub/pull/11910 - please upgrade your CLI version


fix(presenter): design fixes

🍰 Pullrequest

Fixes design and layout bugs.
Issues

fixes #129
fixes #152

Todo

[x] check safari issues and make sure they are fixed
[x] fix href scroll offset
[x] get rid of small line, below video slider
[x] focus inputs after href click #184

Singular Plural

There is a hydration error regarding z-index, which might be fixable:

Server: z-index:1006;
Client: z-index:1004;

There is a hydration error regarding z-index, which might be fixable:
Server: z-index:1006; Client: z-index:1004;

i'll have a closer look again tomorrow. but could be a possible vuetify bug?
see: https://github.com/vuetifyjs/vuetify/issues/19002


GIL information

Hi,
I was wondering if you thought about visualizing when a thread has or tries to get the GIL?
cheers,
Maarten

It would be a really nice feature and I did look into it before. However, there's no way(that I know of) to hook the switch of GIL. Also, the front-end(chrome trace viewer) did not support this kind of visualization. Hacking into the front-end for this kind of feature is probably too much at this point.
One thought that I have for now, is to use a function entry as a suggestion of "holding the GIL", and visualize which thread has it in an optional separate event signal(maybe under --log_gil?) that is calculated rather than recorded when the trace is parsed. I could try a prototype this weekend and I'll let you know if it's promising.

What about visualizing it similar to a single thread/process, where each gil lock would be visualized as a separate function call. So if you have pure Python, it would be a single call, and every time the GIL is released, it is 'idle'. The function name could be the thread-id that has the GIL.

However, there's no way(that I know of) to hook the switch of GIL.

Can you elaborate a bit? Are you saying, you only get called by the profiler machinery, if the thread is not running, you cannot do anything from that thread?
Would it be an idea to do polling? You could have 1 extra thread continuously checking (every X msec, or X usec?) if the GIL is locked, and which thread has it. Looking at https://github.com/python/cpython/blob/5977a7989d49c3e095c7659a58267d87a17b12b1/Python/pystate.c#L1433 and https://github.com/python/cpython/blob/63298930fb531ba2bb4f23bc3b915dbf1e17e9e1/Include/internal/pycore_runtime.h#L35 it sounds like it should be possible to figure that out. I guess even doing that ever usec shouldn't be too resource consuming.
You might also be interested in:
https://www.youtube.com/watch?v=HtbLNgXmLrw&ab_channel=EuroPythonConference

Visualization would be less of a problem. Like I said, having a separate event signal for GIL is doable. The problem is getting data.
Polling is not a good idea in general, for VizTracer, because it's against VizTracer's fundamental idea. A very important basic of VizTracer is that it's not only a profiler. It is an execution recorder. Polling for GIL might be helpful for a sampling thread profiler, but it will generate confusing data for VizTracer. For example, You can't tell when or if GIL switched between two samples, so it's highly possible that you will show in the report that some thread has the GIL, but the other thread is calling a function(which is not supposed to happen in Python).
The more frequently you poll, the more overhead you will introduce. Making it meaningful for VizTracer(instead of a sampling profiler) will definitely bring the overhead to a comparable level as the current overhead itself. Basically, it's still a conflict between the idea of polling and VizTracer.
What I can try, as I mentioned earlier, is try to guess GIL with function calls, which is already hooked anyway. Every time a function is called or returned, the thread has the GIL. This way, we will lose nothing while the program is running, and some time when we parse the log(and it would be optional).

I think we wouldn't know in between when the GIL is release (all threads
executing), is that correct?
Maybe the polling could be extra information apart from checking at
function calls. Would you think the overhead is large, if it is polled
every 10usec in c?
I'm surprised there is no API/callback for this.
(from mobile phone)
On Fri, Dec 11, 2020, 21:23 gaogaotiantian<EMAIL_ADDRESS>wrote:

Visualization would be less of a problem. Like I said, having a separate
event signal for GIL is doable. The problem is getting data.
Polling is not a good idea in general, for VizTracer, because it's against
VizTracer's fundamental idea. A very important basic of VizTracer is that
it's not only a profiler. It is an execution recorder. Polling for GIL
might be helpful for a sampling thread profiler, but it will generate
confusing data for VizTracer. For example, You can't tell when or if GIL
switched between two samples, so it's highly possible that you will show in
the report that some thread has the GIL, but the other thread is calling a
function(which is not supposed to happen in Python).
The more frequently you poll, the more overhead you will introduce. Making
it meaningful for VizTracer(instead of a sampling profiler) will definitely
bring the overhead to a comparable level as the current overhead itself.
Basically, it's still a conflict between the idea of polling and VizTracer.
What I can try, as I mentioned earlier, is try to guess GIL with function
calls, which is already hooked anyway. Every time a function is called or
returned, the thread has the GIL. This way, we will lose nothing while the
program is running, and some time when we parse the log(and it would be
optional).
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/gaogaotiantian/viztracer/issues/60#issuecomment-743408526,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AANPEPO2ZAKL2SN4PFOOV7DSUJ5VPANCNFSM4UWRLG2Q
.

I checked the C/Python API again. I'm afraid there's no easy way to even check which thread is hold the GIL. Maybe if I can do some really hacky thing for the data structure, but that may cause a racing condition that I'm not aware of. 10us polling is actually a pretty high frequency. Especially considering that there's thread context switch involved. Also I doubt if you can guarantee a 10us polling because the scheduler might not be able to do it. As a comparison, python GIL switching is 5ms by default.
I'm leaning towards to giving polling up for the uncertainties:

The public C/Python API does not give you a way to access current thread that's holding GIL
Racing condition to access the data is unknown
Overhead might be high, considering the thread context switch and the polling frequency
Even if everything works, we still need a thread-safe(no lock) way to store the data to make it meaningful. Sync issues with the circular buffer

Unless someone could come up with a prototype of polling that is

Safe, won't break the program in any cases
Reasonably fast, does not increase the overhead by 20%+
Meaningful
Working on 3.6 - 3.9 with all OS supported.
to convince me, I won't move forward on this.

However, I will check the possibility of using the existing data to infer the GIL status. If that's promising I will add it, if not then we'll probably need to wait for someone that's better than me to create the feature.

FYI, py-spy does detect gil, but I just reported it not working
https://github.com/benfred/py-spy/issues/329 🙂
(from mobile phone)
On Fri, Dec 11, 2020, 23:43 gaogaotiantian<EMAIL_ADDRESS>wrote:

I checked the C/Python API again. I'm afraid there's no easy way to even
check which thread is hold the GIL. Maybe if I can do some really hacky
thing for the data structure, but that may cause a racing condition that
I'm not aware of. 10us polling is actually a pretty high frequency.
Especially considering that there's thread context switch involved. Also I
doubt if you can guarantee a 10us polling because the scheduler might not
be able to do it. As a comparison, python GIL switching is 5ms by default.
I'm leaning towards to giving polling up for the uncertainties:

The public C/Python API does not give you a way to access current
thread that's holding GIL
Racing condition to access the data is unknown
Overhead might be high, considering the thread context switch and
the polling frequency
Even if everything works, we still need a thread-safe(no lock) way
to store the data to make it meaningful. Sync issues with the circular
buffer

Unless someone could come up with a prototype of polling that is

Safe, won't break the program in any cases
Reasonably fast, does not increase the overhead by 20%+
Meaningful
Working on 3.6 - 3.9 with all OS supported.
to convince me, I won't move forward on this.

However, I will check the possibility of using the existing data to infer
the GIL status. If that's promising I will add it, if not then we'll
probably need to wait for someone that's better than me to create the
feature.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/gaogaotiantian/viztracer/issues/60#issuecomment-743465232,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AANPEPPIAOAZWRCIKIIXBOLSUKOA3ANCNFSM4UWRLG2Q
.

FYI, I'm looking into using the perf to get notified on thread state changes, and with the callstacks I can see if is due to GIL 'take' or 'drop'
python 302631 [018] 3485124.202569:       sched:sched_switch: prev_comm=python prev_pid=302631 prev_prio=120 prev_state=S ==> next_comm=swapper/18 next_pid=0 next_prio=120
        ffffffff96ed4785 __sched_text_start+0x375 ([kernel.kallsyms])
        ffffffff96ed4785 __sched_text_start+0x375 ([kernel.kallsyms])
        ffffffff96ed4b92 schedule+0x42 ([kernel.kallsyms])
        ffffffff9654a51b futex_wait_queue_me+0xbb ([kernel.kallsyms])
        ffffffff9654ac85 futex_wait+0x105 ([kernel.kallsyms])
        ffffffff9654daff do_futex+0x10f ([kernel.kallsyms])
        ffffffff9654dfef __x64_sys_futex+0x13f ([kernel.kallsyms])
        ffffffff964044c7 do_syscall_64+0x57 ([kernel.kallsyms])
        ffffffff9700008c entry_SYSCALL_64_after_hwframe+0x44 ([kernel.kallsyms])
            7f2b30a97376 futex_wait_cancelable+0x216 (inlined)
            7f2b30a97376 __pthread_cond_wait_common+0x216 (inlined)
            7f2b30a97376 __pthread_cond_wait+0x216 (inlined)
            55f77685fe17 drop_gil+0x51 (inlined)
            55f7769c2916 _PyEval_EvalFrameDefault+0x6226 (/home/maartenbreddels/miniconda/envs/dev/bin/python3.7)
            55f776931b67 PyEval_EvalFrameEx+0x117 (inlined)
            55f776931b67 function_code_fastcall+0x117 (inlined)
            55f776931b67 _PyFunction_FastCallDict+0x117 (/home/maartenbreddels/miniconda/envs/dev/bin/python3.7)

I think that's more promising than trying to do it from userspace.

That will involve a third party program, which I will try my best to avoid. Also this is linux only. Also I'm not sure about the overhead of perf.
However, it would be a interesting tool to use something like this to get a precise GIL performance.

Yeah, totally understand that, would be great if viztracer could do without. However, I may want to add in more information, for instance from the kernel (kernel tracing/events) which I want to combine. I think it can be complementary.
 I don't know yet if that is the GIL or not, but already interesting. Visualization can be done better, and it required manual clock synchronization (and seems off)
This is the code that was run:
import threading
import viztracer
import time
import os
import sys

print(os.getpid())

def run():
    total = 0
    for i in range(1_000_000):
        total += i
    return total

with viztracer.VizTracer(output_file="threads-3.json"):
    thread1 = threading.Thread(target=run)
    thread2 = threading.Thread(target=run)
    thread1.start()
    thread2.start()
    time.sleep(0.2)
    for thread in [thread1, thread2]:
        thread.join()

Yeah, one of the problem of using a third party program is actually the clock synchronization.

Ok, I dove into this a bit, (https://docs.google.com/document/d/1CvAClvFfyA5R-PhYUmn5OOQtYMH4h6I0nSsKchNAySU/preview#heading=h.rgcugfne66rf and https://docs.google.com/document/d/1RPg7O8lHhYFYQA41OWKEYvD81PV6D1KWFv062k0cWhw ) on android they seem to use a version of ftrace to do some synchronization. It's not clear exactly how it works, but my idea was that if snaptrace_start would do a call to sleep, I could find that moment back in the call stack, and do some synchronization.
However, it's much simpler when combining with perf, since it supports settings the clock $ perf -k CLOCK_MONOTONIC ... which is the same clock that viztracer uses! problem solved.
I like the idea of this --combine, because I can simply do a perf2traceevent script, and it would be independent from viztracer.
It would be nice to include the FlowEvents as well, to signal which process wakes up who (for instance using mutex/semaphore).
Simple counters, such as page faults, memory reads, and cycle and instruction counters (as indicators of mem bandwidth saturation) can be overlayed (here I'm using S for sleeping state).

Hmm, now it looks super interesting. if perf can provide so much information, then it would be an interesting discussion to include it in VizTracer(still working in parallel and automatically combine the reports together). The user can specify like --log_perf or something like that, then VizTracer can run perf along with the script, and generate a combined html report. I have considered flow events, there are some minor issues there but I won't say it's impossible.
I think rich features like this can let us forget that it's Linux only for now.

Hmm, I realized perf does not support WSL2 well. I guess it would interesting to make a third party tool to generate chrome trace event compatible json files and use --combine to build the report.

I'm thinking about adding some standard plugin format so people can develop their own tools that generates chrome trace format compatible data, and VizTracer can load the plugin easily and combine the report automatically.
Something like viztracer --plugin linux-perf "args". I probably need to take a look at other plugins to figure out the design and the way to use it.

Hmm, I realized perf does not support WSL2 well.

Not well, or not at all? I saw the hardware counters are not all working, but tracepoints might work (to get the process state).
I like the idea of having a plugin option, but in general i cannot use viztracer from the command line (all the imports add too much to the json).
Have you thought instead of injecting the profiler in a running progress, sth like
$ viztracer record -P <pid> -- sleep 3

I know this can be done with gdb.

You basically need to compile from source to make perf work partially on WSL2.
If you use --ignore_non_file, you won't record anything from import. Hope that'll help.
I could design a plug-in architecture for both command line and inline usage. That takes some time. It would be really helpful for you to describe the process you need to get data from perf(and convert), so I can design the plug-in architecture properly to make this happen(and with reasonably good separations).
I actually thought about remote control recently. Using gdb to inject code is probably risky(I heard that could cause dead-lock in some cases). I think I have some prototype to install the viztracer first(withouth enabling it) and enable it through signals. That's not perfect, because you still can't profile any process you want, but that's something.

Take a look at entrypoints or pluggy for a plugin system, and yes, signals are a way out, but maybe it's also good to have an unsafe option (as a last resort).
I've put the project at https://github.com/maartenbreddels/per4m as a demo, I'm not sure I have the bandwidth to pursue this seriously, but at least it's more reproducable this way.
I'm surprised this GIL visualization problem got so little attention.

Btw, windows has xperf, and osx has instruments, at least it should be possible to get process state out of them, and for sure also hardware performance counters.

I'll take a look at your implementation when I have some time and figure out if this should be something that I pursue(and how). As for gdb code injection, that probably requires much more work. I won't do it immediately, but I may take a look at it in the future. And as always, anyone that thinks this as an interesting project is welcome to make a prototype for proof of concept, and eventually a PR for it.

As an example
https://github.com/lmacken/pyrasite/blob/d0c90ab38a8986527c9c1f24e222323494ab17a2/pyrasite/injector.py#L22 (warning, it is GPL)

I've made it easy to combine perf and viztracer:
$ pip install per4m
 # follow https://github.com/maartenbreddels/per4m#linux-side
$ per4m giltracer -m per4m.example2

Which should give sth like this:

Thanks for your help on this, this is very useful (feel free to close, if you consider it closed)

The info you got from perf is interesting. I'll spend some time on it to see if I can make it an internal plugin for viztracer

Hi, @maartenbreddels , I have added the plugin structure to viztracer in master. I was wondering if you would like to try it out and adapt your current code to a plugin of VizTracer.
You can install viztracer by pip install git+https://github.com/gaogaotiantian/viztracer as it's not officially released yet. I tried to describe how to develop a plugin in https://viztracer.readthedocs.io/en/latest/viz_plugin.html and how to use them in https://viztracer.readthedocs.io/en/latest/plugins.html. It's pretty straightforward to me. Also it's not hard to develop one as it's basically a message handler.
However, I know you must be busy with your own project, so I totally understand that you've already had what you need and won't spend more time on this matter.
Either way, I'm planning to make some official plugins in the next week or so, for some extra optional features for VizTracer.
Cheers.

The plugin feature is released. I have no current plan to implement GIL detection because it requires too much pre-setup. Close it for now.

The plugin feature is released. I have no current plan to implement GIL detection because it requires too much pre-setup. Close it for now.


TextAlignment mistake  on apple silicon

In sketch JSAPI and sketch-file-format-ts, text center alignment is value 2 and right is 1.
But on apple silicon, When I set the text alignment to center, JSAPI returns 'right' and Objective-C api returns 1 too.
I unzipped the .sketch file, the alignment of the corresponding text is indeed 2.
When I run sketch by Rosetta, It works correctly.

This has nothing to do with skpm, let's keep https://github.com/skpm/skpm/issues/297 only


fix: Karpenter eventbridge naming

:bangbang: PLEASE READ THIS FIRST :bangbang:
The direction for EKS Blueprints will soon shift from providing an all-encompassing, monolithic "framework" and instead focus more on how users can organize a set of modular components to create the desired solution on Amazon EKS. We have updated the examples to show how we use the https://github.com/terraform-aws-modules/terraform-aws-eks for EKS cluster and node group creation. We will not be accepting any PRs that apply to EKS cluster or node group creation process. Any such PR may be closed by the maintainers.
We are hitting also the pause button on new add-on creations at this time until a future roadmap for add-ons is finalized. Please do not submit new add-on PRs. Any such PR may be closed by the maintainers.
Please track progress, learn what's new and how the migration path would look like to upgrade your current Terraform deployments. We welcome the EKS Blueprints community to continue the discussion in issue https://github.com/aws-ia/terraform-aws-eks-blueprints/issues/1421
What does this PR do?
🛑 Please open an issue first to discuss any significant work and flesh out details/direction - we would hate for your time to be wasted.
Consult the CONTRIBUTING guide for submitting pull-requests.

Motivation

Resolves #1482 #1471

More

[x] Yes, I have tested the PR using my local account setup (Provide any test evidence report under Additional Notes)
[ ] Yes, I have updated the docs for this feature
[x] Yes, I ran pre-commit run -a with this PR

For Moderators

[ ] E2E Test successfully complete before merge?

Additional Notes

- Tested

@dtherhtun can you please re-open this PR against https://github.com/aws-ia/terraform-aws-eks-blueprints-addons repo? This is going to be the new home for blueprints addons repo going forward as a part of changes described in #1421.


Terrascan 1.13.2 version uses go 1.16.14 version which has High vulnerability. When can we expect the release with go version 1.17?

Hi @SayaliMane05, we're planning to release the new version with 1.17 by tomorrow.

Thank you @cesar-rodriguez

With the latest release, we are now using go 1.17. @SayaliMane05 Thanks for reporting the issue.

Hi, I see some vulnerabilities in latest terrascan version 1.16.0 :

Latest terrascan version contains Go version 1.19.1 which is vulnerable. This is fixed in go version 1.19.2, 1.18.7
Latest terrascan version contains go-getter version 1.5.11 which is vulnerable. This vulnerability is fixed in go-getter version 1.6.1 and 2.1.0
open-policy-agent/opa version 0.22.0 is vulnerable. This is fixed in version 0.42.0
When can we expect the release with these vulnerabilities fixed?
Thanks,
Sayali.


Add "print screen" as a key that can be used for taking screenshots.

I'm using this key for other clients to take screenshots. Can't I use it on your client too?

You can change screenshot hotkey in Screenshot plugin settings

Looks like Hotkey do not supports printscreen

https://coderanch.com/t/333483/java/PrintScreen-button-pressed
One of the posts states:
Looked in the Java Bug database... looks like you can't detect anything other than keyReleased on the print screen key on Windows, since the Windows OS doesn't produce a KEY_DOWN message for it...

We use keyPressed everywhere, so a potential solution is to change to keyReleased for settings keybinds and for the screenshot plugin. keyReleased obviously can't be used with features such as the wasd camera, so don't change them all (this means print screen can't be used for those - but who would do that?).


Document that Jinja2 projects should configure undefined to use ChainedUndefined

Further information regarding this can be found in the Jinja2 docs: https://jinja.palletsprojects.com/en/3.0.x/api/#jinja2.Undefined
Add the following import:
from jinja2 import ChainableUndefined

and the following configuration change:
jinja_env.undefined = ChainableUndefined

Relates to https://github.com/ONSdigital/eq-questionnaire-runner/pull/909

@kruncher Is this linked to #1931?

@kruncher Is this linked to #1931?

Yes, there should be less to document overall in terms if Jinja2 support if the chainable undefined config works in eQ when testing the PR #2359
There is a separate piece about documenting how iterables should be provided to things like itemsList parameters such that the DS doesn't need to know python app specifics.


Add Milkomeda A1 configs

[x] Mainnet

Not sure if the branch base is correct, hence please check this one too. cc @nicarq @rinor @NicolasDP

Seems good to me

Closing because there are ugly merge conflicts and this PR is to the wrong repo anyway


libdvdnav: 4.2.1 -> 5.0.3

Similar to #6886 except the old version of libdvdnav is kept so that mplayer can use it.

@spwhitt will you keep an eye on dependency builds on hydra? like ffmpeg etc.

Absolutely.


Zoom Extent in 2D elements

When creating a single line element (i.e. a column) it is impossible to show it in full extent view. Scrolling zoom does not end.
The views are automatically adapted when entering a node outside the line, but the node must be removed before lanching the .in file

please provide the .geo file containing the definition of the column

(change suffix .geo of file into .get.txt)

Hi,
Please find the file attached.
Regards
LORENZO LELLI
DIRECTEUR
@.***
De : gmsafir @.>
Envoyé : samedi, 11 février 2023 20:36
À : gmsafir/gmsafir @.>
Cc : Lelli, Lorenzo @.>; Author @.>
Objet : Re: [gmsafir/gmsafir] Zoom Extent in 2D elements (Issue #56)
This is the first time you've received an email from this sender. Make sure this is someone you trust.
please provide the .geo file containing the definition of the column
—
Reply to this email directly, view it on GitHubhttps://zendata.urlsand.com/?u=https%3A%2F%2Fgithub.com%2Fgmsafir%2Fgmsafir%2Fissues%2F56%23issuecomment-1426861015&e=c0c93621&h=1d800494&f=n&p=y, or unsubscribehttps://zendata.urlsand.com/?u=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAY6EU25V56334SNG4RZLX5DWW7S2LANCNFSM6AAAAAAUXTRTGA&e=c0c93621&h=97ccf7ca&f=n&p=y.
You are receiving this because you authored the thread.Message ID<EMAIL_ADDRESS>

sorry, the .geo.txt and .g4s.txt files are not there

Hi,
Please find attached both files.
Thanks
LORENZO LELLI
DIRECTEUR
[signature_2557868076]
From: gmsafir @.>
Reply to: gmsafir/gmsafir @.>
Date: Tuesday, 14 February 2023 at 07:38
To: gmsafir/gmsafir @.>
Cc: "Lelli, Lorenzo" @.>, Author @.***>
Subject: Re: [gmsafir/gmsafir] Zoom Extent in 2D elements (Issue #56)
sorry, the .geo.txt and .g4s.txt files are not there
—
Reply to this email directly, view it on GitHubhttps://zendata.urlsand.com/?u=https%3A%2F%2Fgithub.com%2Fgmsafir%2Fgmsafir%2Fissues%2F56%23issuecomment-1429198869&e=c0c93621&h=5e1fbe2c&f=n&p=y, or unsubscribehttps://zendata.urlsand.com/?u=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAY6EU2YGJKF5NB3JMETWS2DWXMR5VANCNFSM6AAAAAAUXTRTGA&e=c0c93621&h=0d77f7d0&f=n&p=y.
You are receiving this because you authored the thread.Message ID: @.***>
##########################################################################################################
################################## GENERAL PROPERTIES ####################################################
##########################################################################################################
Problem Type: Structural 3D
Title1 : Safir_Structural_Analysis
Title2 : Mesh_from_G4S-Mesher
Name of the .IN File : untitled.IN
Consider max displacement : NO
MAX DISPL : 999
PRECISION : 0.001
NG BEAM : 2
Thermal elongation : EPSTH
TIMEPRINT,UPTIMEPRINT : 30,3600
NG SHELLTHICK : 0
NG SOLID : 0
Mode : DYNAMIC PURE NR
Convergence : COMEBACK = {
TIMESTEPMIN : 1e-05
TIMESTEP,UPTIME,TIMESTEPMAX : 1,3600,8
}
outputs : PRINT = {
PRINTDEPL Print the increment of displacement or of temperature : NO
PRINTTMPRT Print the temperature in the beam fibers : NO
PRINTVELAC Print velocity and acceleration : NO
PRINTFHE Print out of balance forces : NO
PRINTREACT Print the reactions : YES
PRINTMN Print the internal forces in beam elements : YES
PRNEIBEAM Print the stiffness EI in beam elements : NO
PRINTSHELL Print the stresses in shell elements : NO
PRNNXSHELL Print the membrane forces in shell elements : NO
PRNMXSHELL Print the bending moments in shell elements : NO
PRNEASHELL Print the membrane stiffness EA in shell elements : NO
PRNEISHELL Print the membrane stiffness EI in shell elements : NO
}
##########################################################################################################
################################## THERMO-MECHANICAL PROPERTIES ###########################################
##########################################################################################################
############### List of MATERIALS already defined (not necessarily assigned to entities/physgroups) ###############
############### List of LAX already defined (not necessarily assigned to entities/physgroups) ###############
Curve - New LAX Definition : laz = {
Check=LAX from local angle, Uncheck=LAX from fix coords : NO
Rotation angle (deg) of Y' around X' : 0
Reverse X' axis : 0
Y'(dx,dy,dz) : 1,0,0
}
############### PROPERTIES assigned to Entities ###############
############### PROPERTIES assigned to Groups ###############
Point - Block Constraint(Physical Point 2) = {
X : F0
Y : F0
Z : F0
Theta-X : NO
Theta-Y : NO
Theta-Z : F0
W : F0
}
Point - Block Constraint(Physical Point 3) = {
X : F0
Y : F0
Z : NO
Theta-X : NO
Theta-Y : NO
Theta-Z : NO
W : F0
}
Curve - Beam Section Local Axes(Physical Curve 4) = {
LAX Name : laz
}
Point - Loads on Node(Physical Point 5) = {
Load Function : FLOAD
X-Force : 0
Y-Force : 0
Z-Force : -100000
X-Moment : 16000
Y-Moment : 16000
Z-Moment : 0
}
Curve - Unif Distr Loads on Beam(Physical Curve 4) = {
Load Function : F1
X Pressure : 0
Y Pressure : 0
Z Pressure : -100
}
Curve - Mass on Beam(Physical Curve 4) = {
Distributed-Beam-Mass : 200
Rotational-Inertia : 1
}
// Gmsh project created on Tue Jan 31 11:49:36 2023
SetFactory("OpenCASCADE");
//+
Point(1) = {0, 0, 0, 0.5};
//+
Point(2) = {0, 0, 3, 0.5};
//+
Line(1) = {1, 2};
//+
Physical Point("BOTTOM_SUPPORT", 2) = {1};
//+
Physical Point("UPPER_SUPPORT", 3) = {2};
//+
Physical Curve("COLUMN", 4) = {1};
//+
Physical Point("CONCENTRATED_LOADS", 5) = {2};

please update your gmsh API by calling in your command window:
python.exe install -i https://gmsh.info/python-packages-dev --force-reinstall --no-cache-dir gmsh
and it shall work better

Hi,
I’ve the following error :
C:\WINDOWS\system32>python.exe install -i https://gmsh.info/python-packages-dev --force-reinstall --no-cache-dir gmsh
python.exe: can't open file 'C:\WINDOWS\system32\install': [Errno 2] No such file or directory
Is there anything wrong with the syntax of the command line?
Thanks
LORENZO LELLI
DIRECTEUR
@.***
De : gmsafir @.>
Envoyé : mercredi, 15 février 2023 15:47
À : gmsafir/gmsafir @.>
Cc : Lelli, Lorenzo @.>; Author @.>
Objet : Re: [gmsafir/gmsafir] Zoom Extent in 2D elements (Issue #56)
please update your gmsh API by calling in your command window:
python.exe install -i https://gmsh.info/python-packages-devhttps://zendata.urlsand.com/?u=https%3A%2F%2Fgmsh.info%2Fpython-packages-dev&e=c0c93621&h=a75099ff&f=n&p=y --force-reinstall --no-cache-dir gmsh
and it shall work better
—
Reply to this email directly, view it on GitHubhttps://zendata.urlsand.com/?u=https%3A%2F%2Fgithub.com%2Fgmsafir%2Fgmsafir%2Fissues%2F56%23issuecomment-1431485436&e=c0c93621&h=62cae3c5&f=n&p=y, or unsubscribehttps://zendata.urlsand.com/?u=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAY6EU2Z2NJFOEV34QFSKD2TWXTT7RANCNFSM6AAAAAAUXTRTGA&e=c0c93621&h=5c8a92ba&f=n&p=y.
You are receiving this because you authored the thread.Message ID<EMAIL_ADDRESS>

sorry, there was a typo in the command, here is the correct command:
python.exe -m pip install -i https://gmsh.info/python-packages-dev --force-reinstall --no-cache-dir gmsh

Perfect,
Thanks,
I’ll close the issue on the hub adding this command line or are you going to do it?
Regards
LORENZO LELLI
DIRECTEUR
@.***
De : gmsafir @.>
Envoyé : jeudi, 16 février 2023 11:17
À : gmsafir/gmsafir @.>
Cc : Lelli, Lorenzo @.>; Author @.>
Objet : Re: [gmsafir/gmsafir] Zoom Extent in 2D elements (Issue #56)
sorry, there was a typo in the command, here is the correct command:
python.exe -m pip install -i https://gmsh.info/python-packages-devhttps://zendata.urlsand.com/?u=https%3A%2F%2Fgmsh.info%2Fpython-packages-dev&e=c0c93621&h=a75099ff&f=n&p=y --force-reinstall --no-cache-dir gmsh
—
Reply to this email directly, view it on GitHubhttps://zendata.urlsand.com/?u=https%3A%2F%2Fgithub.com%2Fgmsafir%2Fgmsafir%2Fissues%2F56%23issuecomment-1432847453&e=c0c93621&h=04ed90cc&f=n&p=y, or unsubscribehttps://zendata.urlsand.com/?u=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAY6EU27YJLNDEIZZ7MTK4ULWXX5BNANCNFSM6AAAAAAUXTRTGA&e=c0c93621&h=144ffd0f&f=n&p=y.
You are receiving this because you authored the thread.Message ID<EMAIL_ADDRESS>

perfect, you can close it

Run the following instruction in command prompt:
python.exe -m pip install -i [https://gmsh.info/python-packages-dev] --force-reinstall --no-cache-dir gmsh

Run the following instruction in command prompt:
python.exe -m pip install -i [https://gmsh.info/python-packages-dev] --force-reinstall --no-cache-dir gmsh


added installment steps + fixed up grammar

added download links
added references
added python/pip install steps if they're using mule
misc:
inconsistencies (headers caps for instance)
commas
misc grammar

Summary
Explain the goal of this change and what problem it is solving. Format this cleanly so that it may be used for a commit message, as your changes will be squash-merged.
Test Plan
How did you test these changes? Please provide the exact scenarios you tested in as much detail as possible including commands, output and rationale.

Codecov Report

Merging #548 (df5c741) into develop (2f4aa0b) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff            @@
##           develop     #548   +/-   ##
========================================
  Coverage    34.18%   34.18%
========================================
  Files           24       24
  Lines         4842     4842
========================================
  Hits          1655     1655
  Misses        2948     2948
  Partials       239      239

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2f4aa0b...df5c741. Read the comment docs.


[BUG]: QA| Clicking on the case transfer add signature button is throwing the internal server error.

Step to reproduce :

Generate the application for case transfer by an advocate.
Approve the case transfer and click the "Add Signature" button as a judge.(Same issue with Case withdrawal order as well)
Verify that the "Add Signature" popup displays correctly; currently, it is showing an internal server error.

link:https://jam.dev/c/ffb6373c-69e2-48e6-afeb-aa543259a208

Hi @vaibhavct, As @manimaarans  mentioned, this is a pdf service error issue ; can you please look into it?

It is working as expected when the respondent joins a case.


Demo link seems to be broken

I cannot reach the demo...

@caneta you can clone the project and run in your localhost. I did it!

Well, ok, but this is not the point...I would only notify about an annoying broken link.

I sent a email to project creator talking about this.

@Luitame any response? I have host the demo page here http://bootstrap-calendar.eivissapp.com/

@eleazan that's right. Now it's functioning. Please, change link in project home page.

@Luitame i can't :(

I have updated description with new link.


Opera constantly crashes

Issue description
Opera (62.0.3331.43) constantly crashes.
Steps to reproduce
Open the Extensions page by navigating to chrome://extensions, enable Developer mode then Load unpacked to select an extension directory.
Technical details
$ opera --version
> 62.0.3331.43

$ opera
…
(opera:7067): GLib-GIO-ERROR **: 15:53:56.593: No GSettings schemas are installed on the system
…

$ nix run nixpkgs.nix-info -c nix-info -m
 - system: `"x86_64-linux"`
 - host os: `Linux 4.19.71, NixOS, 19.09pre192418.e19054ab3cd (Loris)`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.3`
 - channels(root): `"nixos-19.09pre192418.e19054ab3cd"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

Needs wrapGAppsHook with gtk.
Will fix :+1:


Remove VanillaYosysUhdmPlugin runner

With updated yosys version VanillaYosysUhdmPlugin and UhdmYosys runners are the same.
All required patches are already upstream in yosys.
This PR removes VanillaYosysUhdmPlugin runner and adapts UhdmYosys to use systemverilog plugin (renamed uhdm).
This PR needs to be merged after: https://github.com/antmicro/yosys-uhdm-plugin-integration/pull/640.

This PR is ready for review. I've checked new failing tests and they should fail (we doesn't support features they are testing).


404 at: /engine/reference/builder/

URL: /engine/reference/builder/
Two ways to reach this...

Search for dockerfile reference (https://docs.docker.com/search/?q=dockerfile) => https://docs.docker.com/engine/reference/builder/
Link on the left hand side (Docker Engine -> Dockerfile reference) at https://docs.docker.com.

Fixed in #1286


l_dist term when instance_num=1

I am using you discriminative loss function for another use. And I discovered that if instance_num==1, the l_dist term will become nan because mu_norm=[]. So I suggest to add a sentence like l_dist = tf.cond(num_instances<=1, lambda:tf.zeros(1, dtype=tf.float32), lambda:tf.reduce_mean(mu_norm)) after the calculation of l_dist term.
Do you think it's necessary? If so, may I add a pull request to your repo?

@AlbertHuyb I got a complaint about the tensor's shape using your command when instance_num==1, changing from tf.zeros(1, dtype=tf.float32) to tf.constant(0, dtype=tf.float32) works for me


Fix up how OpImageTexelPointer is interpreted.

The only spot we do anything special with OpImageTexelPointer is when trying to get the base pointer.  In that place, we treat it like an OpAccessChain where it manipulates the operand pointer.
When looking at an example that uses it, I think this interpretation is not the best way of thinking about it.  Consider the following example,
               OpCapability SampledBuffer
               OpCapability StorageImageExtendedFormats
               OpCapability ImageBuffer
               OpCapability Shader
          %1 = OpExtInstImport "GLSL.std.450"
               OpMemoryModel Logical GLSL450
               OpEntryPoint GLCompute %2 "min" %gl_GlobalInvocationID
               OpExecutionMode %2 LocalSize 64 1 1
               OpSource HLSL 600
               OpDecorate %gl_GlobalInvocationID BuiltIn GlobalInvocationId
               OpDecorate %4 DescriptorSet 4
               OpDecorate %4 Binding 70
       %uint = OpTypeInt 32 0
          %6 = OpTypeImage %uint Buffer 0 0 0 2 R32ui
%_ptr_UniformConstant_6 = OpTypePointer UniformConstant %6
%_ptr_Private_6 = OpTypePointer Private %6
       %void = OpTypeVoid
         %10 = OpTypeFunction %void
     %uint_0 = OpConstant %uint 0
     %uint_1 = OpConstant %uint 1
     %v3uint = OpTypeVector %uint 3
%_ptr_Input_v3uint = OpTypePointer Input %v3uint
%_ptr_Image_uint = OpTypePointer Image %uint
          %4 = OpVariable %_ptr_UniformConstant_6 UniformConstant
         %16 = OpVariable %_ptr_Private_6 Private
%gl_GlobalInvocationID = OpVariable %_ptr_Input_v3uint Input
          %2 = OpFunction %void None %10
         %17 = OpLabel
         %18 = OpLoad %6 %4
               OpStore %16 %18
         %19 = OpImageTexelPointer %_ptr_Image_uint %16 %uint_0 %uint_0
         %20 = OpAtomicIAdd %uint %19 %uint_1 %uint_0 %uint_1
               OpReturn
               OpFunctionEnd

In this case, the atomic add is not updating the local variable.  The best way of treating this is that the OpImageTexelPointer is like a load of the input pointer and a manipulation of the value loaded.  We need to treat it that way.
In particular, ADCE needs to know treat it like a load so that the store to the local is not removed.

This code does not look "right" to me.
I think there is something missing in the SPIR-V spec.
Specifically, it is surprising to me that there is not a rule in the spec that requires the Storage Class of the Image in an OpImageTexelPointer to be "Image".
The spec requires the Storage Class of the Result Type pointee to be "Image". Shouldn't the Storage Class of the pointer and the pointee match? It is hard to imagine why these should not be required to match. What good is the requirement for the pointer otherwise?
If indeed it is decided that the Image must be of Storage Class "Image", then the code in this issue is invalid and this issue can be closed. I suspect the other issues related to this one can then also be closed as such pointers cannot be interpreted to point at Private or Function scope variables.


composer install && npm install Error

I can not build, the following error appear when I try to run  composer install && npm install
`
bower install && gulp --production
module.js:327
throw err;
^
Error: Cannot find module '../../modules/es6.string.iterator'
...
npm ERR! Failed at the @ postinstall script 'bower install && gulp --production'.
npm ERR! This is most likely a problem with the  package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     bower install && gulp --production
npm ERR! You can get information on how to open an issue for this project with:
`
npm ERR! node v4.6.1
npm ERR! npm  v3.10.8

hej,
try to update node and npm, should do the trick :)


blacklisting all sites broken

While whitelisting all sites works fine via the command b!wl sites all, blacklisting does not. The following commands all result in the same error:
b!bl sites all
b!bl site all
b!blacklist site all
b!blacklist sites all

The error is: "Failed to blacklist undefined: undefined" followed by an unchanged blacklisted sites list.

Ah, that's because I forgot a spread operator lol
Changes are live on BooruBot, I'll push to git when I can


Incorrect generation of dictionary.txt

During training (which fails silently), I get very strange entries in the dictionary.txt file in the profile/fr/kaldi/model/ folder.
adam a d A~
('adam', 2)(a d a m)

This looks like a format issue...
Also got in the logs:
ERROR (arpa2fst[5.5]:Input():kaldi-io.cc:756) Error opening input stream /profiles/fr/kaldi/model/data/lang/words.txt

The words.txt file is not there (re-downloaded the profile + kaldi). No changes.

Got it! This must've been a mistake during refactoring. It'll happen when there's more than one pronunciation for a word. Fixed in master.


Not saving

I get the editor working and everything seems to be working smoothly, but when I go to save, the gear icon just spins indefinitely.
Any help would be greatly appreciated!
Thanks!

Hey, can you please provide errors from console and versions of octobercms and other plugins?

Okay, my fault. I had the slim version of jquery running when I needed the full version for ajax. Sorry about that. Thanks for making an awesome plugin! You're the best!


Syntax error in a component file does not display the error

Visiting the URL of a preview example that attempts to render a component with a syntax error in it results in results in 'preview not found' message.
This is not very helpful because it effectively swallows the error message making it hard to debug.
It should display the Rails error instead.

Fixed in https://github.com/allmarkedup/lookbook/releases/tag/v0.7.2-beta.0


Realtime exact count

the issue is described at: https://groups.google.com/forum/#!topic/druid-user/XUyMunhftks
i understand this may not be fixed, but @fjy said a test would help and @nishantmonu51 was kind enough to help me finish it: https://github.com/eLod/druid/commit/33176e4e5810b2d7740929be3f50c89c7b02e1f6

IMO this is not a bug but is an intentional design choice and is reasonable for what Druid is intended to do. (see also post @ https://groups.google.com/d/msg/druid-user/XUyMunhftks/oItttIycCgAJ)
@fjy, @nishantmonu51, any thoughts?


Allow tests to have strict variables

Similar to how the future parser ability works, this will allow catalogs
to be compiled with strict variable parsing turned on.

This is superseded by #212


How to implement Featured / Hero Image for Blog Posts (and other pages)

When we are creating a blog index page on vuepress we want to show the hero/featured image of the blog post so that we have a nice image (humans love pictures!) and that image is specified by blog post author (not by index page creator!)
When creating a blog post I want to have the images in the same directory so that all the content is in one place and easy to see and reference
NB: this is also applies to other pages e.g. job or product pages where we may wish to show their featured image elsewhere
The challenge: the preference to keep content in same directory as post and to reference in other pages (e.g. blog index) may be in tension!

Other pages only have access to frontmatter plus rendered content ... (this is just how static site generators work and vuepress in particular) => there's no way to get a list of images used in a page and e.g. use the first one
Assets pipeline of vuepress "mangles" the paths of files (because web assets)
Frontmatter therefore can only reference files in public

See https://github.com/vuejs/vuepress/issues/79 and esp answer from author saying this is way to go https://github.com/vuejs/vuepress/issues/79#issuecomment-381601276 (long further discussion but answer as of Jan 2020 is that this is only way to do it)

Reference:
https://github.com/vuejs/vuepress/issues/165
https://stackoverflow.com/questions/51322398/linking-to-assets-in-vuepress
https://vuepress.vuejs.org/guide/assets.html#public-files
Acceptance

[ ] frontmatter images of blog posts showing up on other website pages even when not in public directory

Tasks

[x] Work out if we want to reuse blog post main image elsewhere
[x] Can we do that w/o it being in public => ANS: No => have to move that image to public

TODO: evidence for that ...

[x] What are our options then?

Don't have featured image
Move featured / hero image to public directory

[x] Can we have sub-directories of public

[x] Implement that option

[x] Choose subfolder in public (do we just use /img/ or create another one just for blog)
[ ] Move images there and update blog posts

How do we deal with blog posts with no image in blog listing page?

just show a placeholder image (e.g. the logo)
To have a layout that support image and non-image blog posts

I moved the images to /img/blog/, tried it on one blog post (Dataship) and it worked.

TODO: change paths of the rest of the blog posts...

FIXED. See http://next.frictionlessdata.io/blog/.


Fix issues with NextJS example

1)Localhost 3002 - not starting, errors: https://prnt.sc/sfVYHg86zd4m, https://prnt.sc/qRO6Ndcoqx9r, https://prnt.sc/SFJVo7b0RbKb, https://prnt.sc/DJ_SyMyzEYPw .
2)Localhost 3001 - starting with errors: https://prnt.sc/aLY_OZTIlclx, https://prnt.sc/asDnY1ad3R0J, https://prnt.sc/rMt9c4Ap9k2R . 2.1) Test Broken Remotes page - http://localhost:3001/home/test-broken-remotes is blank and have errors
3)Localhost 3000 - starting, but some pages have errors: 3.1)Test Broken Remotes page http://localhost:3000/home/test-broken-remotes: https://prnt.sc/Dp-6MZu_2m6p, https://prnt.sc/BGBa45UxJnNt

1 - While building this project, we get a type error on build-utils.ts that can be fixed bu casting global before using it:
const globalScope =         typeof window !== 'undefined' ? window : global.__remote_scope__;
2 - When navigating to localhost:3001/home/test-remote-hook, we get this error:
Uncaught Error: shop_useCustomRemoteHook__WEBPACK_IMPORTED_MODULE_1___default(...).default is not a function
Replacing const text = useCustomRemoteHook.default(); for const text = useCustomRemoteHook(); in apps/3000-home/pages/home/test-remote-hook.tsx fixed the issue.
3 - Sometimes, when we navigate to localhost:3001, we get those errors:
failed generating CSR image path TypeError: Cannot read properties of null (reading 'split')
Warning: Prop src did not match. Server: "http://localhost:3001/_next/static/media/webpack.34cc7761.png" Client: "/_next/static/media/webpack.34cc7761.png"
Those errors does not appear all the time and I couldn't find the exact steps to reproduce it other than keep navigating and refreshing pages. Similar errors also appear on other pages were there are images.
4 - If we navigate to localhost:3002, than click in "Shop" in the navbar and then refresh the page, we get the following error:
Warning: Can't perform a React state update on a component that hasn't mounted yet. This indicates that you have a side-effect in your render function that asynchronously later calls tries to update the component. Move this work to useEffect instead.
I tracked this issue to the way the navbar logic is implemented on all _app.tsx:
const { asPath } = useRouter();
const [MenuComponent, setMenuComponent] = useState(() => HostAppMenu);
  const handleRouteChange = async (url) => {
    if (url.startsWith('/shop')) {
      // @ts-ignore
      const RemoteAppMenu = (await import('shop/menu')).default;
      setMenuComponent(() => RemoteAppMenu);
    } else if (url.startsWith('/checkout')) {
      // @ts-ignore
      const RemoteAppMenu = (await import('checkout/menu')).default;
      setMenuComponent(() => RemoteAppMenu);
    } else {
      setMenuComponent(() => HostAppMenu);
    }
  };
  // handle first route hit.
  React.useMemo(() => handleRouteChange(asPath), []);

  //handle route change
  React.useEffect(() => {
    // Step 3: Subscribe on events
    Router.events.on('routeChangeStart', handleRouteChange);
    return () => {
      Router.events.off('routeChangeStart', handleRouteChange);
    };
  }, []);

Change the implementation to the following seems to fix the issue, but it needs to be reproduced on all of the _app.tsx files:
// @ts-ignore
const ShopMenu = dynamic(() => import('shop/menu'), {
  ssr: true,
});

// @ts-ignore
const CheckoutMenu = dynamic(() => import('checkout/menu'), {
  ssr: true,
});

function MyApp(props) {
  const { Component, pageProps } = props;
  const { asPath } = useRouter();

  const showShopMenu = asPath.startsWith('/shop');
  const showCheckoutMenu = asPath.startsWith('/checkout');
  const showHostMenu = !showShopMenu && !showCheckoutMenu;

  return (
    <Layout style={{ minHeight: '100vh' }}>
      <SharedNav />
      <Layout>
        <Layout.Sider width={200}>
          <Suspense>
            { showShopMenu && <ShopMenu/> }
            { showCheckoutMenu && <CheckoutMenu/> }
            { showHostMenu && <HostAppMenu/> }
          </Suspense>
        </Layout.Sider>
        <Layout>
          <Layout.Content style={{ background: '#fff', padding: 20 }}>
            <Component {...pageProps} />
          </Layout.Content>
          <Layout.Footer
            style={{ background: '#fff', color: '#999', textAlign: 'center' }}
          >
            antd@{version}
          </Layout.Footer>
        </Layout>
      </Layout>
    </Layout>
  );
}

5 - Sometimes a image loads but after navigating for a while, we start to get 404 for it.

Send a PR

If no one can even start with an example from the repo, how are they supposed to work with MF?


Next.js publish deployment failed

How did you install the Amplify CLI?
npm
If applicable, what version of Node.js are you using?
v16.16.0
Amplify CLI Version
10.6.2
What operating system are you using?
Windows
Did you make any manual changes to the cloud resources managed by Amplify? Please describe the changes made.
No
Describe the bug
When I run amplify publish everything seems to work until the static site is attempted to be deployed. At that time the process reports "Deploying build artifacts to the Amplify Console..Job failed"
Expected behavior
Successful deployment of the static site
Reproduction steps

amplify env add qa
amplify env checkout qa
amplify publish

Project Identifier
17e769013bb424051ecafa7a8d884571
Log output

2023-02-01T18:29:38.027Z|info : amplify publish core  {"debug":true,"yes":false}
2023-02-01T18:29:38.113Z|info : amplify-cli-core.banner-message/index.ts.fetch banner messages from https://aws-amplify.github.io/amplify-cli/banner-message.json({}
2023-02-01T18:29:39.706Z|info : amplify-provider-awscloudformation.system-config-manager.getProfileConfig(["xxx-qa-amplify"])
2023-02-01T18:29:39.708Z|info : amplify-provider-awscloudformation.system-config-manager.getProfiledAwsConfig.profileConfig([{"region":"us-east-1"}])
2023-02-01T18:29:39.708Z|info : amplify-provider-awscloudformation.system-config-manager.getProfileCredentials(["xxx-qa-amplify"])
2023-02-01T18:29:39.724Z|info : amplify-provider-awscloudformation.system-config-manager.getProfileConfig(["xxx-qa-amplify"])
2023-02-01T18:29:39.725Z|info : amplify-provider-awscloudformation.system-config-manager.getProfiledAwsConfig.profileConfig([{"region":"us-east-1"}])
2023-02-01T18:29:39.726Z|info : amplify-provider-awscloudformation.system-config-manager.getProfileCredentials(["xxx-qa-amplify"])
2023-02-01T18:29:39.734Z|info : amplify-provider-awscloudformation.zip-util.downloadZip.s3.getFile([{"Key":"[***]rent-[***]ud-[***]d.zip"},null])
2023-02-01T18:29:39.738Z|info : amplify-provider-awscloudformation.aws-s3.s3.getFile([{"Key":"[***]rent-[***]ud-[***]d.zip","Bucket":"[***]ify-[***]plifyapp-[***]a-[***]451-[***]ment"}])
2023-02-01T18:29:40.617Z|info : amplify-provider-awscloudformation.initialize-env.run.cfn.updateamplifyMetaFileWithStackOutputs([{"StackName":"[***]ify-[***]plifyapp-[***]a-[***]451"}])
2023-02-01T18:29:40.627Z|info : amplify-provider-awscloudformation.aws-cfn.updateamplifyMetaFileWithStackOutputs.cfn.listStackResources([{"StackName":"[***]ify-[***]plifyapp-[***]a-[***]451"}])
2023-02-01T18:29:40.985Z|info : amplify-provider-awscloudformation.aws-cfn.describeStack.cfn.describeStacks([{"StackName":"[***]ify-[***]plifyapp-[***]a-[***]451"}])
2023-02-01T18:29:41.309Z|info : amplify-provider-awscloudformation.aws-cfn.describeStack.cfn.describeStacks([{"StackName":"[***]rmation:us-[***]st-[***]67:stack/[***]ify-[***]plifyapp-[***]a-[***]451-[***]uthStack-[***]F0295V/[***]c850-[***]54-[***]ed-[***]71-[***]98fc1"}])
2023-02-01T18:29:41.313Z|info : amplify-provider-awscloudformation.aws-cfn.describeStack.cfn.describeStacks([{"StackName":"[***]rmation:us-[***]st-[***]67:stack/[***]ify-[***]plifyapp-[***]a-[***]451-[***]egsAPI-[***]X58QK/[***]5600-[***]54-[***]ed-[***]7f-[***]d1493"}])
2023-02-01T18:29:41.315Z|info : amplify-provider-awscloudformation.aws-cfn.describeStack.cfn.describeStacks([{"StackName":"[***]rmation:us-[***]st-[***]67:stack/[***]ify-[***]plifyapp-[***]a-[***]451-[***]8146b33a8146b33a-[***]ASNXL1/[***]d870-[***]54-[***]ed-[***]8b-[***]fc231"}])
2023-02-01T18:29:41.317Z|info : amplify-provider-awscloudformation.aws-cfn.describeStack.cfn.describeStacks([{"StackName":"[***]rmation:us-[***]st-[***]67:stack/[***]ify-[***]plifyapp-[***]a-[***]451-[***]olGroups-[***]SP7UN/[***]07c0-[***]54-[***]ed-[***]e1-[***]29ff7"}])
2023-02-01T18:29:41.319Z|info : amplify-provider-awscloudformation.aws-cfn.describeStack.cfn.describeStacks([{"StackName":"[***]rmation:us-[***]st-[***]67:stack/[***]ify-[***]plifyapp-[***]a-[***]451-[***]ectByVersion-[***]A67DH/[***]e200-[***]54-[***]ed-[***]35-[***]2bddb"}])
2023-02-01T18:29:41.321Z|info : amplify-provider-awscloudformation.aws-cfn.describeStack.cfn.describeStacks([{"StackName":"[***]rmation:us-[***]st-[***]67:stack/[***]ify-[***]plifyapp-[***]a-[***]451-[***]sForS3Object-[***]WWR81C/[***]8540-[***]54-[***]ed-[***]2c-[***]30437"}])
2023-02-01T18:29:41.323Z|info : amplify-provider-awscloudformation.aws-cfn.describeStack.cfn.describeStacks([{"StackName":"[***]rmation:us-[***]st-[***]67:stack/[***]ify-[***]plifyapp-[***]a-[***]451-[***]fyhosting-[***]DULZAM/[***]2510-[***]54-[***]ed-[***]f6-[***]b5d27"}])
2023-02-01T18:29:41.713Z|info : amplify-provider-awscloudformation.aws-s3.s3.getFile([{"Key":"[***]ify-[***]json","Bucket":"[***]ify-[***]plifyapp-[***]a-[***]451-[***]ment"}])
2023-02-01T18:34:35.882Z|info : amplify-provider-awscloudformation.system-config-manager.getProfileConfig(["xxx-qa-amplify"])
2023-02-01T18:34:35.899Z|info : amplify-provider-awscloudformation.system-config-manager.getProfiledAwsConfig.profileConfig([{"region":"us-east-1"}])
2023-02-01T18:34:35.900Z|info : amplify-provider-awscloudformation.system-config-manager.getProfileCredentials(["xxx-qa-amplify"])
2023-02-01T18:53:46.326Z|info : amplify version core
2023-02-01T19:02:24.101Z|info : amplify diagnose core  {"send-report":true,"yes":false}
2023-02-01T19:02:24.194Z|info : amplify-cli-core.banner-message/index.ts.fetch banner messages from https://aws-amplify.github.io/amplify-cli/banner-message.json({}

Additional information
I am attempting to create a new environment for an existing application that is working in another account. I just created the new environment and tried to publish it.
The app is a Next.js ssr app.
Before submitting, please confirm:

[X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
[X] I have removed any sensitive information from my code snippets and submission.

Hey @rupe120 :wave: thanks for raising this! While we begin to take a further look at this would you mind re-running the publish command with --debug and capture the stack trace? When Hosting was originally created, was it set up for manual publishing or the git-connected CI/CD solution with Amplify Hosting?

Hey @rupe120 👋 thanks for raising this! While we begin to take a further look at this would you mind re-running the publish command with --debug and capture the stack trace? When Hosting was originally created, was it set up for manual publishing or the git-connected CI/CD solution with Amplify Hosting?

I just realized that I am actually required to use the hosted Amplify pipeline for Next.js 12 and later. I was trying to move to using a headless deployment in a custom pipeline. I am going back to the developers to see if we need to support SSR.
Thank you for your reply.


Problem with IMAP import

Description
I have a little issue with the IMAP import, that should pull documents from my self-hosted mail server but doesn't seem to function at the moment.
Expected
Papermerge should pull and import documents attached by mail via IMAP.
Actual
Papermerge connects to the inbox, sees unread mails, but doesn't actually import them into the system.
Info

OS: Dockerized app (ghcr.io/linuxserver/papermerge:latest)
Browser: Brave
Database: SQLite
Papermerge Version: 2.0

papermerge.conf.py configuration file
#DBTYPE = "mariadb"
DBUSER = "root"
DBPASS = "root"
DBHOST = "mariadb"
DBNAME = "papermerge"

MEDIA_DIR = "/data/media"
STATIC_DIR = "/app/papermerge/static"
MEDIA_URL = "/media/"
STATIC_URL = "/static/"

BINARY_STAPLER = "/usr/local/bin/stapler"

IMPORTER_DIR = "/importer"

IMPORT_MAIL_HOST = "obi-wan.yeahwh.at"
IMPORT_MAIL_USER =<EMAIL_ADDRESS>IMPORT_MAIL_PASS = "pw"
IMPORT_MAIL_DELETE = True
IMPORT_MAIL_BY_USER = True

OCR_DEFAULT_LANGUAGE = "eng"

OCR_LANGUAGES = {
    "eng": "English",
    "deu": "Deutsch"
}

Relevant logs
[2021-07-12 17:19:50,281: INFO/Beat] Scheduler: Sending due task import_from_local_folder (papermerge.core.management.commands.worker.import_from_local_folder)
[2021-07-12 17:19:50,283: INFO/Beat] Scheduler: Sending due task import_from_email (papermerge.core.management.commands.worker.import_from_email)
[2021-07-12 17:19:50,283: INFO/MainProcess] Task papermerge.core.management.commands.worker.import_from_local_folder[0ca51d89-2e89-4537-af31-61f9d595f1d9] received
[2021-07-12 17:19:50,284: INFO/MainProcess] Task papermerge.core.management.commands.worker.import_from_email[c96275ec-3939-4eb8-bdd0-26d3b55df9d8] received
[2021-07-12 17:19:50,284: DEBUG/ForkPoolWorker-2] Celery beat: import_from_local_folder
[2021-07-12 17:19:50,285: INFO/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.import_from_local_folder[0ca51d89-2e89-4537-af31-61f9d595f1d9] succeeded in 0.0008253850974142551s: None
[2021-07-12 17:19:50,286: DEBUG/ForkPoolWorker-2] Celery beat: import_from_email
[2021-07-12 17:19:50,605: DEBUG/ForkPoolWorker-2] IMAP Import: UNSEEN messages 1 count
[2021-07-12 17:19:50,644: INFO/ForkPoolWorker-2] Task papermerge.core.management.commands.worker.import_from_email[c96275ec-3939-4eb8-bdd0-26d3b55df9d8] succeeded in 0.3582966411486268s: None
[2021-07-12 17:20:19,569: INFO/Beat] Scheduler: Sending due task rebuild_the_tree (papermerge.core.management.commands.worker.rebuild_the_tree)
[2021-07-12 17:20:19,570: INFO/MainProcess] Task papermerge.core.management.commands.worker.rebuild_the_tree[a0a717a1-ab08-4c3f-a1a3-cce5d649d462] received

Is there anyway to further troubleshoot this problem?
Many thanks for working and developing on Papermerge - I love the product! ❤

There may be a problem with document itself i.e. application fails to OCR and/or read data about imported document.
What document format is it ? Is it a PDF file ? TIFF ? Jpeg?
One very simple way to double check that document is "importable" i.e. there are no errors while importing the document, aside from IMAP part, is to upload document from email attachment into the application via web interface.

I've tried with a bunch of random (mechanically generated) PDFs which otherwise worked out fine when importing those manually. None of the few (about 10 different documents) were imported nor were there any other relevant log messages unfortunately.

Hey there,
Unfortunately I have the same issue with version 2.0

The Server sees the unseen messages but don't import them.
If I try to upload the document manually it works.
Can I help somehow to solve the Issue?
Many Thanks for your work 🙏

I had the same problem. It was - in my case - caused by the way, the Apple Mail program attaches files to Emails.
When I sent an email with the attachment via the Apple Mail program it did not work. When I used a webmailer it did.

I habe also an issue with IMAP import and latest linuxserver docker image.
It will always import all new mails/documents within admin account, even the sender mails fits to an other user account and the "routing by user" is activates within config file, and within settings of admin and other user.

Yes, that was the issue - Thanks a log :)
#closed :)

I have also an issue with IMAP import and latest linuxserver docker image. It will always import all new mails/documents within admin account, even the sender mails fits to an other user account and the "routing by user" is activates within config file, and within settings of admin and other user.

I have the same problem. Documents are forwarded to the superuser, even though the IMPORT_MAIL_BY_USER Settings is set True. The mail address of the user is the same als the send mail.
Mails are also complete ignored, when I send them from my iPhone.


Proportional sizing z

It seems like using proportional size for z results in a 0 z-size.  Perhaps we could use some value like innerWidth to determine z-size...

I don't think a z-size off the bat makes sense.  Proportional works but because everything starts as a dom element, zsize of 0 makes sense to me.

Sorry for the late response.
I think that giving our scene depth would be more intuitive and more consistent with our sizing models.  Currently, if a famous user want to align or proportionally size z values, they have to add pixel depth to their scene first.  On the other hand, x and y values have starting values based on the visible bounds of the screen.
It's been suggested that we use the near and far clipping planes of our frustrum to specify our scene's z-size, and I think that makes sense considering that it specifies visible bounds of our scene.

This has been put on our radar and will be implemented as we approach our frustrum model, in the near future.
@redwoodfavorite

@redwoodfavorite I am still a bit unsure about this.  I would want to do some use rtesting to see what was expected.

Not in love with this idea.  We will leave as is for time being.


Parameterize Resources

Allow resource requests and limits to be configured for individual installations.
The current values are defaulted in the default values.yaml.

@jbeard6 I can take this over to make the changes needed to merge these changes.

Closed in favor of #80


Remove execute_extrinsics_without_checks as it will not be required

This functionality was added by me for Cumulus, but after better
understanding Cumulus, this will not be required.

will need runtime version bumo and rebuild


Restore ReshuffleTriggerTest to SDK

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

[x] Make sure the PR title is formatted like:
[BEAM-<Jira issue #>] Description of pull request
[x] Make sure tests pass via mvn clean verify. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
[x] Replace <Jira issue #> in the title with the actual Jira issue
number, if there is one.
[x] If this contribution is large, please file an Apache
Individual Contributor License Agreement.

R: @lukecwik
This restore was missed in a64acb2f from #1083, where all prior trigger files were restored for compatibility. We have some internal dependencies lingering.

Jenkins failures are actually internal failures of the Dataflow service, not this PR.

Your comment makes it seem like the ReshuffleTriggerTests aren't useful. Are they not useful anymore?

ReshuffleTriggerTest still provides unit tests for ReshuffleTrigger. Both are going away ASAP, but this restore should definitely be done.

Rebased to kick Jenkins now that integration tests might be able to pass.

LGTM

I'll follow up with a git diff --stat on util before and after #1083, which should be a noop. I had previously neglected that directory.


new config devServer override key not working

When overriding the config with an object using the keys (webpack, jest, devServer), the devServer key is not working.
However using devserver works as intented.
I think devServer is probably better (as per README documentation), so it'd be good to rename the key in the code, right?

see #157 #161

@likun7981 No sure why you are closing the issue this bug is still there. It was introduced by  in version 1.3.6 and broke our tests because the certificate did not work anymore.
To reproduce it, use the extended configuration options example which uses the devServer key. The certificate is not added when serving the site.
In terms of the config key to use, devServer seems slightly better to use since the same word is used in the webpack config. See webpack docs.

This is a break change, so consider now is not to change the original usage. it will be changed in later versions, so you do not have to worry about. the doc is wrong , it is our fault, we will update it

@bdo
the plan is:

align readme with implementation in 1.x
cleanup/rename in 2.x

PR for readme is welcomed

Hmm, sorry. It was originally called devServer in https://github.com/timarney/react-app-rewired/pull/157
So, let's fix it one more time. Sorry for the mess.
Tests in 2.x is high priority.

@guria Thanks for double checking !
PR is already available: #172 ;)

@likun7981 Thanks for reopening the issue.
Any chance of reopening and reviewing PR #172 please ?
If I can help on the project on something else please shout :wink:

I think do not change, most people are sure to use devserver,even if it's not perfect,
when the 2.0 update it. @Guria what do you think?

Or we can add a warning for those who use devserver and then add the devServer option like #157

Anyone using the option prior to this mess would already have been using "devServer", so changing the case to "devserver" now will break their configuration. Their current config will need updating for the change (and the need to update how the devServer option was used was the reason why the original pull request making changes to the devServer option was reverted to be held back until version 2.0).

I do not know why  keep this wrong configuration option devserver.

let's make both and add warning within devserver

@Guria I can update PR #172 to add a warning for those using devserver, accepting for now both devServer and devserver.
But could you please reopen it first?

@Guria @likun7981 PR #172 is now also allowing devserver but issues a warning when used.


Populate test chain with seed data

Closes #2224.

I merged this PR into mine so this can close as abandoned(?)
https://github.com/AugurProject/augur/pull/2252


Handle empty lines, background drawing, and multicolor lines

Handle edge case where a line is made up of white space, fix bug where trying to call CTRunDraw on a background thread would crash, and fix regression of not being able to have multiple colors in the same line.
Fixes #1130, #1109, and #1171

{}

Refers to: Frameworks/CoreGraphics/CGContextCairo.mm:74 in ff1ac10. [](commit_id = ff1ac10d27c7c380723def25df1d600292450269, deletion_comment = False)

}

not needed

Refers to: Frameworks/CoreText/DWriteWrapper.mm:129 in ff1ac10. [](commit_id = ff1ac10d27c7c380723def25df1d600292450269, deletion_comment = False)

}

I think this is in the wrong place?

In reply to: 254926542 [](ancestors = 254926542)

Refers to: Frameworks/CoreText/DWriteWrapper.mm:129 in ff1ac10. [](commit_id = ff1ac10d27c7c380723def25df1d600292450269, deletion_comment = False)

if (DEBUG_VERBOSE) {

not needed.

Refers to: Frameworks/QuartzCore/CALayer.mm:497 in ff1ac10. [](commit_id = ff1ac10d27c7c380723def25df1d600292450269, deletion_comment = False)

:shipit:

:shipit:


@aws section isn't used in npx deploy

Describe the bug
Running npx deploy doesn't read the @aws section for profile and/or region.
To Reproduce
Steps to reproduce the behavior:

Make new project with a specific profile and region field in the .arc file:

@app
myapp

@aws
region us-west-2
profile mynew_profile

@html
get /

Run npx create ensure it works properly, adding the correct route
Run npx deploy
See error:

Deploying 1 lambda
deploy myapp-staging-get-index failed
{ UnrecognizedClientException: The security token included in the request is invalid.
....)
  message: 'The security token included in the request is invalid.',
  code: 'UnrecognizedClientException',
  time: 2018-07-09T20:20:37.906Z,
  requestId: 'xxxxxx-xxxx-xxxx-xxxx-xxxx',
  statusCode: 403,
  retryable: false,
  retryDelay: xx.xxxx }

Expected behavior
It should deploy.
Screenshots
N/A
Desktop (please complete the following information):

OS: Mac OSX
Browser N/A
Command line

Additional context
N/A

sorry for the delay just getting around to this today! tried to reproduce but wan't able to. wondering if this is a shell $PATH lookup thing.
🕵♂ Do you have AWS_PROFILE and AWS_REGION set?

It doesn't but I thought it doesn't make much sense to have the @aws section for profile and/or region if I have to actually make sure I have those env variables set outside of the .arc file as well.

I only recently heard about envrc files. Looking into it it requires installing direnv
https://direnv.net
And a prompt changing entry or similar (changing cd makes more sense to me) in the shell rc script, which checks for working director envrc files and calls them (every time a prompt is output), so it seems to allow different environment variables depending on the working directory.
Not that I'm using it but it seems like it could have some good uses. In this case, it probably makes no difference, still I thought I would mention it.

Hey @jonathanstiansen we added @aws because we increasingly see ppl w multiple accounts but apps tend to only be installed in one. This is classic infra as code thinking: we're versoining the delivery target.
Weirdly AWS themselves pretty much require those env vars to be set for many things in the aws-sdk. So removing that from the default path would cause a lot of problems. Thinking maybe we need better docs here.

Hey y'all quick update on this. We now default values for both AWS_REGION and AWS_PROFILE so working locally offline should work even if you are on a machine without AWS setup. LMK if you see any issues and we'll jump back on this!

Just a quick note the default values (with no env variables set) seem to be broken on<EMAIL_ADDRESS>If I remove
@aws
region us-east-1
profile default

From my .arc, npx deploy will fail with UnrecognizedClientException per this issue.

Was the project in question deployed at any previously, or was it created for the first time when running npx deploy?

Sorry, brain not working well as I'm a bit sick. Re-reading what you wrote: yes, deploy should fail.
Architect uses some default values, but they're only stubs to get sandbox running (as Brian mentioned in August).
As for deploying, though, if you don't pass Architect a region and a profile to use when deploying, what exactly is it deploying to?
Sounds like the issue at hand is that deploy needs some better error messaging. Please do feel free to open a separate issue for that!


RWA-1311 - fix security issues

Before creating a pull request make sure that:

[ ] commit messages are meaningful and follow good commit message guidelines
[ ] README and other documentation has been updated / added (if needed)
[ ] tests have been updated / new tests has been added (if needed)

Please remove this line and everything above and fill the following sections:
JIRA link (if applicable)
Change description
Does this PR introduce a breaking change? (check one with "x")
[ ] Yes
[X] No

Outdated issue.

Outdated issue.


fix(distributor): Forcing restart if integration is malformed (#6309)

Signed-off-by: RealAnna<EMAIL_ADDRESS>

This PR

updates go utils
exits if integrationID is empty

Related Issues

Fixes #6309
How to test

LGTM! But it seems there are conflicts with master, can you please run git pull --rebase origin master ?

Is it maybe possible to add a unit test for the check ? If yes, can you add it please ?


Add graceful shutdown

When the apllication is closing it should take a few seconds to persist the unsaved things to the disk, dispose connections, etc...
A simple code like this shuld happen there:
cts.Cancel();
walletJobTask.Wait()

Good idea.
I'll keep this open for now as I need to see how this can be done properly when taking into consideration the graceful shutdown of the underlying full node components.

done


Add support for DHCP CNI plugin IPAM options and set the DHCP host-name option properly

Fixes #1103.
cc @AkihiroSuda @theodiem

Rebased.
The cni plugins sha failure is now gone.
PTAL.
Still some (random?) CI failure - unless I am responsible for these, it seems to me these are just flaky. It is really annoying.
I want these problems gone. Will have a look at them once done with image inspect.


The Inverse

Type: Bug
There is a shorthand in Matlab and octave -
It is for the transpose function
It is written by insterting an apostrophe and is appears positioned after a vector or matrix usually one letter in upper case.
At the moment it comments.
The rest of the program turns red/orange/pink.
I would like to see usage of this transpose shorthand in the editor recognized as a command for transpose.  This will render the text back to white.
The formula I am working on is the following :
theta = theta - X' * (X*theta-y);
Thank you,
Mar
VS Code version: Code 1.74.0 (5235c6bb189b60b01b1f49062f4ffa42384f8c91, 2022-12-05T16:38:16.075Z)
OS version: Windows_NT x64 10.0.19045
Modes:
Sandboxed: No

System Info

Item
Value

CPUs
Intel(R) Core(TM) i3-6100U CPU @ 2.30GHz (4 x 2304)

GPU Status
2d_canvas: enabledcanvas_oop_rasterization: disabled_offdirect_rendering_display_compositor: disabled_off_okgpu_compositing: enabledmultiple_raster_threads: enabled_onopengl: enabled_onrasterization: enabledraw_draw: disabled_off_okskia_renderer: enabled_onvideo_decode: enabledvideo_encode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabledwebgpu: disabled_off

Load (avg)
undefined

Memory (System)
7.88GB (2.83GB free)

Process Argv
C:\Users\Admin\Desktop\ex1-octave\gradientDescent.m --crash-reporter-id c3401ebf-18f0-40c8-8659-aa1f7951b157

Screen Reader
no

VM
0%

Extensions (13)

Extension
Author (truncated)
Version

isort
ms-
2022.8.0

python
ms-
2022.20.0

vscode-pylance
ms-
2022.12.20

jupyter
ms-
2022.11.1003412109

jupyter-keymap
ms-
1.0.0

jupyter-renderers
ms-
1.0.12

vscode-jupyter-cell-tags
ms-
0.1.6

vscode-jupyter-slideshow
ms-
0.1.5

remote-wsl
ms-
0.72.0

cmake-tools
ms-
1.12.27

cpptools
ms-
1.13.6

cpptools-extension-pack
ms-
1.3.0

cmake
twx
0.0.17

(1 theme extensions excluded)

A/B Experiments
vsliv368cf:30146710
vsreu685:30147344
python383cf:30185419
vspor879:30202332
vspor708:30202333
vspor363:30204092
vslsvsres303:30308271
pythonvspyl392:30443607
vserr242cf:30382550
pythontb:30283811
vsjup518:30340749
pythonptprofiler:30281270
vsdfh931:30280409
vshan820:30294714
vstes263cf:30335440
vscorecescf:30445987
pythondataviewer:30285071
vscod805cf:30301675
binariesv615:30325510
bridge0708:30335490
bridge0723:30353136
cmake_vspar411:30581797
vsaa593cf:30376535
pythonvs932:30410667
cppdebug:30492333
vsclangdc:30486549
c4g48928:30535728
dsvsc012:30540252
azure-dev_surveyone:30548225
vscccc:30610679
pyindex848:30577860
nodejswelcome1:30587005
2e4cg342:30602488
gswce1:30612156
3d0df643:30613357
dbltrim-noruby:30604474
89544117:30613380
fim-prod:30623723

We try to keep VS Code lean and we think the functionality you're asking for is great for a VS Code extension. Maybe you can already find one that suits you in the VS Code Marketplace. Just in case, in a few simple steps you can get started writing your own extension. See also our issue reporting guidelines.
Happy Coding!


Update feature shows wrong current version

After upgrading from 0.9.10 to 0.9.13 I noticed that the update feature in the top left shows the currently installed version as 0.9.12.

I have the Windows version and confirmed 0.9.13 is installed.

Thank you for reporting this.
I am pretty sure I know what caused this. Will be solved in the next release.


Delete Kube jobs when we delete a Pipeline

Currently we only delete the JobInfos in rethinkdb but not the jobs we submitted to kubernetes.
We need to delete the kubernetes jobs because we have a deterministic approach to job naming which means that if someone deletes and recreates a pipeline they'll see errors from kubernetes because the new pipeline can't create jobs due to name conflicts with the jobs created by the last version of the pipeline.

We do have the code right now which is supposed to do exactly this: https://github.com/pachyderm/pachyderm/blob/master/src/server/pps/server/api_server.go#L868-L872
However I have run into instances where jobs failed to be removed.  I did not pinpoint the cause though.

One way I know of reproducing this is just restarting the cluster and recreating the pipeline.
Since currently pfs data survives restarts and pps doesn't that will leave you in a state where you get errors. Have you seen other ways of reproducing it or do you think it might have been that one?

Yeah I definitely remember deleting a pipeline, restarting the cluster, and some jobs were still there.  I'm not sure if that was 100% reproducible though.

This has been fixed now by a couple of different prs. Closing.


Occurs AttributeError: 'NoneType' object has no attribute 'encode' error when using a2wsgi with keystonemiddleware

Hi guy,
I try to transfer keystonemiddleware to asgi middleware with a2wsgi module. However, it occurs AttributeError when I send a request. Errors are as follows:
INFO:     ::ffff:<IP_ADDRESS>:58980 - "GET /v1/flow_types HTTP/1.1" 500 Internal Server Error
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/uvicorn/protocols/http/h11_impl.py", line 408, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/usr/local/lib/python3.9/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in __call__
    return await self.app(scope, receive, send)
  File "/usr/local/lib/python3.9/site-packages/fastapi/applications.py", line 1106, in __call__
    await super().__call__(scope, receive, send)
  File "/usr/local/lib/python3.9/site-packages/starlette/applications.py", line 122, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/usr/local/lib/python3.9/site-packages/starlette/middleware/errors.py", line 184, in __call__
    raise exc
  File "/usr/local/lib/python3.9/site-packages/starlette/middleware/errors.py", line 162, in __call__
    await self.app(scope, receive, _send)
  File "/usr/local/lib/python3.9/site-packages/starlette/middleware/cors.py", line 83, in __call__
    await self.app(scope, receive, send)
  File "/usr/local/lib/python3.9/site-packages/scorch/middlewares.py", line 36, in __call__
    await app(scope, receive, send)
  File "/usr/local/lib/python3.9/site-packages/a2wsgi/wsgi.py", line 157, in __call__
    return await responder(scope, receive, send)
  File "/usr/local/lib/python3.9/site-packages/a2wsgi/wsgi.py", line 191, in __call__
    await self.loop.run_in_executor(
  File "/usr/lib64/python3.9/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.9/site-packages/a2wsgi/wsgi.py", line 244, in wsgi
    for chunk in self.app(environ, start_response):
  File "/usr/local/lib/python3.9/site-packages/webob/dec.py", line 129, in __call__
    resp = self.call_func(req, *args, **kw)
  File "/usr/local/lib/python3.9/site-packages/webob/dec.py", line 193, in call_func
    return self.func(req, *args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/keystonemiddleware/auth_token/__init__.py", line 340, in __call__
    response = req.get_response(self._app)
  File "/usr/local/lib/python3.9/site-packages/webob/request.py", line 1313, in send
    status, headers, app_iter = self.call_application(
  File "/usr/local/lib/python3.9/site-packages/webob/request.py", line 1281, in call_application
    output.extend(app_iter)
  File "/usr/local/lib/python3.9/site-packages/a2wsgi/asgi.py", line 207, in __call__
    asgi_task = self.start_asgi_app(environ)
  File "/usr/local/lib/python3.9/site-packages/a2wsgi/asgi.py", line 194, in start_asgi_app
    self.app(build_scope(environ), self.asgi_receive, self.asgi_send),
  File "/usr/local/lib/python3.9/site-packages/a2wsgi/asgi.py", line 75, in build_scope
    headers = [
  File "/usr/local/lib/python3.9/site-packages/a2wsgi/asgi.py", line 76, in <listcomp>
    (key.lower().replace("_", "-").encode("latin-1"), value.encode("latin-1"))
AttributeError: 'NoneType' object has no attribute 'encode'

Afterwards, I tried to troubleshoot it and found some value of environ variable is None, such as ('OPENSTACK_SYSTEM_SCOPE', None), ('X_DOMAIN_ID', None), ('X_DOMAIN_NAME', None). a2wsgi try to handle some headers in environ at build_scope function of asgi.py file. Using value.encode("latin-1") statement while value is None leads to the error finally.
So, could you please fix this problem? I will wait for you to solve this and produce new package. Thinks.

Can you share a MRE?

Can you paste this Environ over? a2wsgi will only convert variables starting with HTTP_, and the None ones you mentioned should not enter this branch.
https://github.com/abersheeran/a2wsgi/blob/4833fe444a86e676b50c93e4bc4aee335ce93a67/a2wsgi/asgi.py#L73-L89

Since I can't verify it, I'm temporarily closing this PR. If you can provide more detailed information, please reopen it.

Sorry I don't visit github often and almost forgot such thing. I try to debug environ variale with [print(k, v) for k, v in environ.items()] statement aften entering into build_scope function.
 I know the variables are customized and occur in only a few specified situations. Howerer, I still think it is necessary to judge value's type before value.encode("latin-1") since it raise AttributeError if value is None. Many thanks.

@abersheeran By the way, where is reopen button? I can't see it when commenting. Does it require me to be a contributor?

None should not be allowed for key-value pairs starting with HTTP, what WSGI SERVER are you using？Gunicorn？or Waitress？


Update URLs to reference new cross-rs organisation

bors ping
installed bors, let's see if it works

https://github.com/cross-rs/cross/blob/2f1ef07fdaf92ba31e6d6ce0ab4c5dca63ca0aa7/.github/bors.toml needs to be changed to not include the azure status check

bors r-

Thanks, done. I've also added a new maintainers team and set them as CODEOWNERS for github's automatic review suggestions, and removed rust-embedded/tools from there.


Using an actor name with parentheses causes an abort

I called a Context::actor_of with a name containing ( and ) (I used &format!("{:?}") and determined that it was the () that caused it.
$ cargo run
   Compiling actix v0.1.0 (/Users/anacrolix/src/eratosthenes/rust/riker)
    Finished dev [unoptimized + debuginfo] target(s) in 2.68s
     Running `target/debug/actix`
2020-06-30 04:45:30+00:00 DEBG [riker::system] Starting actor system: System[riker]
2020-06-30 04:45:30+00:00 DEBG [riker::system] Actor system [ea287462-b746-48e2-a584-07db5bfdb1f1] [riker] started
Int(2)

thread 'pool-thread-#10' has overflowed its stack
fatal runtime error: stack overflow
Abort trap: 6

This doesn't only happen when using parens. It also happens when an actor has an invalid name or an actor with the same name already exists.
After a bit of digging it seems that the to_string method on CreateError gets called recursively which destroys the stack.
Code to reproduce:
use riker::actors::*;

fn main() {
    let ce = CreateError::InvalidName("asd".to_string());
    println!("{}", ce.to_string());
}

@hardliner66 https://github.com/riker-rs/riker/pull/123


Can I read a MultiPolygon geojson with this library

Hi alex,
can I read a MultiPolygon geojson with this library?
import json
from shapely.geometry import mapping,shape
from shapely_geojson import FeatureCollection

way = """
{
   "features":[
      {
         "geometry":{
            "coordinates":[
               [
                  [
                     [
<PHONE_NUMBER>,
                        72.1178189
                     ],
                     [
                        142.884063,
                        72.1186622
                     ],
                     [
<PHONE_NUMBER>,
                        72.1820139
                     ],
                     [
<PHONE_NUMBER>,
                        72.1820139
                     ],
                     [
                        143.122329,
                        72.1818038
                     ],
                     [
<PHONE_NUMBER>,
                        72.1178189
                     ]
                  ]
               ]
            ],
            "type":"MultiPolygon"
         },
         "properties":{
            "type":"multipolygon"
         },
         "type":"Feature"
      }
   ],
   "type":"FeatureCollection"
}
"""
shape = FeatureCollection(json.loads(way))

The entire library is one short file: https://github.com/alekzvik/shapely-geojson/blob/master/shapely_geojson.py
The JSON representation is one-way: shapely -> JSON, not the other way around.

GeoJSON is very similar to the __geo_interface__ format that shapely does accept in shapely.geometry.shape(), though, so it shouldn't be too difficult: just convert the json to a dictionary and give it to that function.


Call _ready when creating scene

Is it possible to call _ready() on all nodes when you create a scene with direct.scene()? Currently I have to manually get all nodes and call the _ready() function to initialize variables that I set with onready var.

_ready runs when you enter a Node into the tree. Did you try adding the node as a child?

How would I do that? I don't think I have seen anything like that in the Docs or in your Tests. I am using the direct.scene to create the director and then get the node as a double. Like in your scene_director.test.gd.

var director = direct.scene()
var double = director.double()
add_child(double) // _ready should run here
(I guess it might not be clear but Tests are added to the tree when being run).

I think the _ready is being called now. But variables that are initialized with get_node and a path seem to be null. For example:
export var player_path: NodePath
onready var player: Spatial = get_node(player_path)

It works when I set the player_path manually. Can this somehow be fixed?

I have a few ideas. I'll get back to you.

@myin142 This should be resolved by 4760fb45ac923e33128319d26640016660caf1e3. There is a slight chance it might not work with scenes inherited from other scenes but I think it should be fine now.

Great, it works now. Thanks for the help!


Request specific amound/share address produces a bad address

To reproduce the issue on Android:

Receive
Request a specific ammount
Generate QR code
Share address
Select mail

The address looks like:
{{protocol}}:MZ4GUQC7WUKZKKLGAS3H3FSDKLHI7HFO?amount=1000000000
{{protocol}} should be replaced by byteball

fixed, thanks for reporting!


Paste without formatting

Description of the new feature / enhancement
Office package has a shortcut for pasting text without formatting. It would be handy to able to do this system wide.
Maybe an option only to do this for certain applications, and still use the default shortcut Ctrl-V (perhaps another shortcut for override and still paste with formatting)
Maybe an option to only remove certain types of formatting, font type, font size, font color etc.
Scenario when this would be used?
Pasting into applications where clipboard contents text formatting is not desired, without any extra steps to remove the formatting.
Supporting information
No response

/dup #1684