Add setup.py with new entry point.

Will allow poseidon to be PIP installable and no changing PYTHONPATH

Codecov Report

Merging #297 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #297   +/-   ##
=======================================
  Coverage   73.54%   73.54%
=======================================
  Files          22       22
  Lines        1100     1100
  Branches       91       91
=======================================
  Hits          809      809
  Misses        274      274
  Partials       17       17

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a3e41ed...eeb8e5b. Read the comment docs.

Currently we deploy though docker containers; testing, documentation generation, and execution all share a consistent environment.  I'm not sure that pip installations of the project is the direction it should go.  I'll talk with @cglewis to get another perspective.

Poseidon is not meant to be a library, but instead is an application.  I generally think of pip packages as being used as libraries, so I'm not sure being able to pip install Poseidon really makes a lot of sense in its current (or foreseeable) form.

At this time Docker containers are the way that Poseidon is installed.

If the project was a just a couple of independent scripts I wouldn't bother with setuptools. I think it's worth doing because of the current PYTHONPATH and other path manipulation requirements, as well as opening up the ability to clean up some of the interproject imports. There is a very elaborate module hierarchy under ./poseidon that is being managed manually right now. This will help get a handle on that. This will also let me simplify the Dockerfile a bit. I think applications are okay as pip packages, pip itself for instance is a pip package as well as a ton of other command line tools and stuff. But mostly the point is to remove the dependencies on specialized paths and environment variables.

This is also to partly address #281

@jbenjos you need to address the items in review before this can move forward.

@jbenjos any update on progress for the review items?

There has been no movement on this in 22 days.


Liveness probe failed error on OCP +RHEL worker nodes setup

Describe the bug
When CSI 2.10.0 is installed on OCP + RHEL , it is giving error as  Warning  Unhealthy  73s (x131 over 5h17m)  kubelet  Liveness probe failed: HTTP probe failed with statuscode: 500
How to Reproduce?

Built on Sep 25 2023 at 13:50:08
Running 1 day 21 hours 9 minutes 27 secs, pid 1786248
[worker2 ~]# hostnamectl
   Static hostname: worker2.ocp2.vmlocal
         Icon name: computer-vm
           Chassis: vm
        Machine ID: 3e44890562874e9ea270516dc84a62c5
           Boot ID: 86037a19955c479ba53117f4edaa4cec
    Virtualization: vmware
  Operating System: Red Hat Enterprise Linux 8.8 (Ootpa)
       CPE OS Name: cpe:/o:redhat:enterprise_linux:8::baseos
            Kernel: Linux 4.18.0-477.21.1.el8_8.x86_64
      Architecture: x86-64

Run mmdiag --help for more options
Expected behavior
Liveness probe shouldn't fail
Logs(CSI snap and gpfs snap):
/scale-csi/D.1033/

Is there any impact on workload/functionality? if not I think severity should be reduced @Jainbrt

The scale node health is not healthy in one of the worker node. Scale node probe is keep on failing. Below are the oitput for the health. Please verify once and fix the scale cluster.
`[root@worker2 ~]# /usr/lpp/mmfs/bin/mmhealth node show
Node name:      worker2.ocp2.vmlocal
Node status:    FAILED
Status Change:  1 day ago
Component      Status        Status Change     Reasons & Notices
GPFS           FAILED        1 day ago         local_fs_full(/var/mmfs)
NETWORK        HEALTHY       16 days ago       -
FILESYSTEM     DEPEND        1 day ago         -
DISK           DEPEND        1 day ago         -
FILESYSMGR     DEPEND        1 day ago         -
PERFMON        HEALTHY       16 days ago       -
THRESHOLD      HEALTHY       16 days ago       -`

@saurabhwani5, please close this if verified already

yes , closing this is as this issue is fixed


Fix issue with gpt-image

This PR fixes issue with new gpt-image v 0.9.0 package, that changed its API. This issue caused the error like this:
gpt_image.partition.PartitionEntryError: partition overflows the last allowed Logical Block Address: 2080736 requested: 4100097

To fix this, we need to read another property in Partition object.
Second patch bumps the moulin version, as this is quite critical fix and we need to release it ASAP

Reviewed-by: Ruslan Shymkevych<EMAIL_ADDRESS>

Tested-by: Mykhailo Androsiuk<EMAIL_ADDRESS>


select query with alias auto order by id asc with no alias

select query with alias auto order by id asc with no alias

select * from hm2_user_balances as ub inner join hm2_users as u on u.id = ub.user_id where u.ref = ? and ub.type = ? and ub.amount > ? order by RAND() asc, id asc limit 0, 1

Could you explain a little bit more about the issue you are facing?


fix: report syntax error for invalid hex escape, and avoid double-reporting

Closes #1367
Fix 1: report syntax error for invalid hex escape
This change passes in an error list to escape.c:unescape_hexadecimal and reports a syntax error if the first character isn't hexadecimal, e,g:
  def test_invalid_hex_escape
    assert_errors expression('"\\xx"'), '"\\xx"', [
      ["Invalid hex escape.", 1..3],
    ]
  end

Fix 2: avoid double-reporting of syntax errors during string unescaping
Essentially, this change updates yp_unescape_calculate_difference to not create syntax errors, and we rely entirely on yp_unescape_manipulate_string to report syntax errors.
To do that, this PR adds another (!) parameter to unescape: yp_list_t *error_list. When present, unescape reports syntax errors (and otherwise does not).
However, an edge case that needed to be addressed is reporting syntax errors in this case:
?\u{1234 2345}

In a string context, it's possible to have multiple codepoints by doing something like "\u{1234 2345}"; however, in the character literal context, this is a syntax error -- only a single codepoint is allowed.
Unfortunately, when yp_unescape_manipulate_string is called, there's nothing to indicate that we are in a "character literal" context and that only a single codepoint is valid. yp_unescape_calculate_difference has this context, but no longer reports errors; yp_unescape_manipulate_string doesn't have this context and so no syntax error is reported.
To make this work, this PR:

introduces a new static utility function, yarp.c:yp_char_literal_node_create_and_unescape, which is called when we're parsing YP_TOKEN_CHARACTER_LITERAL
introduces a new public function, yp_unescape_manipulate_char_literal which does the same thing as yp_unescape_manipulate_string but tells unescape that only a single codepoint is expected

Things reviewers should focus on ...
Well, I'm adding a new public function, which is a notable decision. Maybe this doesn't need to be a public function, since we only call it in one place, when parsing YP_TOKEN_CHARACTER_LITERAL?
It also feels funny to me that we're exercising the same code path twice, once during lexing and again during parsing. There may be something deeper we can do avoid unescaping twice, like saving the result on the token.
I'm open to other suggestions on how to fix this.

@flavorjones yeah it's been on my list for quite a while ... https://github.com/ruby/yarp/issues/579

@kddnewton Updated to not export yp_unescape_manipulate_char_literal


Support for HEIC Images

I am unable to upload .heic images despite setting my acceptType as such:

acceptType={["jpg", "gif", "png", "JPG", "heic"]}

If there is something else I have to do to support this file type I would love some suggestions. Otherwise if this is not implemented in this component, I'd love for it to be.
HEIC is the standard image type for iOS devices, so it would be awesome to have this file extension supported!

I second this :)

I second this :)

any updates on it?

Hi, heic is a specific type of image, so I think we can use the new prop allowNonImageType in version 3.1.7 to solve this case. Thank you all.

allowNonImageType does not solve the issue for me.

any updates on this?


chore(cleanup): removed coverage files from git

Current coverage is 44.08% (diff: 100%)

Merging #28 into master will not change coverage

@@             master        #28   diff @@
==========================================
  Files            16         16
  Lines           431        431
  Methods          76         76
  Messages          0          0
  Branches         79         79
==========================================
  Hits            190        190
  Misses          241        241
  Partials          0          0

Powered by Codecov. Last update 02fca7c...6e6a7bb


Add implementation of Fedprox example

Description

This pull request tries to implement the FedProx framework proposed in this paper: https://proceedings.mlsys.org/paper/2020/file/38af86134b65d0f10fe33d30dd76442e-Paper.pdf
FedProx is a synchronous federated learning framework that is very similar to FedAvg except that FedProx adds a proximal term to the local objective that clients wish to minimize (i.e. the training loss function of the client). In other words, a FedProx client will train to minimize the following objective:

where  is the original loss function of clients in FedAvg,  is the weight of the client model in the current training epoch,  is the weight of the global model sent by the server to the client at the beginning of the training, and  is a penalty constant of the proximal term, a hyperparameter of FedProx.
The major problem FedProx tries to solve is the impact of non-IID local training data across clients on the global model. With the proximal term added to the loss function, the training of local models at each client would be less affected by its potentially biased dataset.
Another important feature of FedProx is that for straggling clients, the server will collect partial models from them after waiting for a certain amount of time. However, the authors did not specifically describe their approach of implementation of collecting partial models. Instead, they simulate aggregation of partial models trained by stragglers by choosing a proportion of the selected clients and making them train for fewer epochs. This simulation can be reproduced by setting straggler_simulation: true in the configuration file under clients, but when straggler_simulation: false, the server would just wait for all selected clients to finish, as in FedAvg.
I think this feature of FedProx can be implemented if we enable the urgent request update functionality for the synchronous mode. But in that case, we need some sort of global time clock to determine when to request updates from stragglers. I do not know whether this is a good idea and I just want to ask whether it is a desirable functionality for the Plato framework.
Reference:
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2020). "Federated optimization in heterogeneous networks." Proceedings of Machine Learning and Systems, 2, 429-450.
P.S. Also fixed a bug related to the sleep simulation of clients.
How has this been tested?

Run python fedprox.py -c fedprox_MNIST_lenet5.yml under directory ./examples/fedprox without errors
Types of changes

[x] Bug fix (non-breaking change which fixes an issue) Fixes #
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Checklist:

[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.

Hi @cuiboyuan,
I was recently running FedProx for performance comparison on GPU servers but met this error of tensors on different devices:

Changing line 20 in fedprox_trainer.py to weights = torch.tensor([], requires_grad=False).to(Config().device()) can solve the issue.
https://github.com/TL-System/plato/blob/05b649faf4c18f176155c90b08c509870f0c763c/examples/fedprox/fedprox_trainer.py#L20
Thanks,
Fei

Hi Fei,
Thanks for pointing that out! I have created a PR(#161) to fix the problem you mentioned with your suggested modification and I hope that resolves the error.
Thanks,
Boyuan


Refresh scope

Hello,
is refresh scope supposed to re-create all the beans with in the class when the /refresh endpoint is called?
i have a bean that is loading some xml file from file system, annotated the class with refresh scope, when i change some thing on the xml file and call the /refresh endpoint i do not see the changes,seems like bean recreate did not happen.

I don't understand "re-create all the beans with in the class".  @RefreshScope does not work on @Configuration classes.

@Component
public class HelloBean {
@Value("${application.config.test}")
@RefreshScope
@Bean
public HBean hBean(String value){
	return  new HBean(value);
}

}
after changing the application.config.test value and post to /refresh,  i see that value is changed in the environment but when i try to print the value of the HBean,i still see the old value. am i missing anything?

@ctatineni shouldn't your @Bean definition go in an @Configuration class?

i did try with @configuration first , it did not work and then i saw your comment that @Refreshscope does not work with @Configuration then i changed to @component.
How do i apply refresh scope to beans?

You can't do
@RefreshScope
@Configuration
class MyClass {
  @Bean
  MyBean myBean() { /*...*/ }
}

but can do
@Configuration
class MyClass {
  @Bean
  @RefreshScope
  MyBean myBean() { /*...*/ }
}

sorry I wasn't more specific.

@Configuration
@EnableConfigurationProperties(ConfigProps.class)
public class HelloBean {
@Autowired
ConfigProps configProps;

@RefreshScope
@Bean
public HBean hBean(){
	return  new HBean(configProps.getTest());
}

}
@Configuration
public class HelloBean {
@Value("${application.config.test}")
@RefreshScope
@Bean
public HBean hBean(String test){
	return  new HBean(test);
}

}
i tried both options above and none of them worked, after post to /refresh i see the environment changed but the bean value did not change, do you have an example that i can use?

Do you have a project you could share that I can take a look at?

i am not able to upload the project due to firewall issues, when i post /refresh i see the below logs.
Starting application on WSUSOH3033105W7 with PID 24408 (C:\Users\ct91670.m2\repository\org\springframework\boot\spring-boot\1.2.5.RELEASE\spring-boot-1.2.5.RELEASE.jar started by ct91670 in C:\tboa4\demo1)
2015-07-08 14:35:22.613  INFO 24408 --- [nio-8081-exec-1] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@d960aca: startup date [Wed Jul 08 14:35:22 CDT 2015]; root of context hierarchy
2015-07-08 14:35:22.655  INFO 24408 --- [nio-8081-exec-1] trationDelegate$BeanPostProcessorChecker : Bean 'encrypt.CONFIGURATION_PROPERTIES' of type [class org.springframework.cloud.bootstrap.encrypt.KeyProperties] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying)
2015-07-08 14:35:22.656  INFO 24408 --- [nio-8081-exec-1] trationDelegate$BeanPostProcessorChecker : Bean 'encryptionBootstrapConfiguration' of type [class org.springframework.cloud.bootstrap.encrypt.EncryptionBootstrapConfiguration$$EnhancerBySpringCGLIB$$35f8ddf8] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying)
2015-07-08 14:35:22.670  INFO 24408 --- [nio-8081-exec-1] o.s.boot.SpringApplication               : Started application in 0.086 seconds (JVM running for 12.132)
2015-07-08 14:35:22.753  INFO 24408 --- [nio-8081-exec-1] b.c.PropertySourceBootstrapConfiguration : Located property source: CompositePropertySource [name='configService', propertySources=[MapPropertySource [name='file:c:/props/demo1.yml']]]
2015-07-08 14:35:22.759  INFO 24408 --- [nio-8081-exec-1] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@63ba09a6: startup date [Wed Jul 08 14:35:22 CDT 2015]; parent: org.springframework.context.annotation.AnnotationConfigApplicationContext@d960aca
2015-07-08 14:35:22.770  INFO 24408 --- [nio-8081-exec-1] o.s.boot.SpringApplication               : Started application in 0.197 seconds (JVM running for 12.231)
2015-07-08 14:35:22.770  INFO 24408 --- [nio-8081-exec-1] s.c.a.AnnotationConfigApplicationContext : Closing org.springframework.context.annotation.AnnotationConfigApplicationContext@63ba09a6: startup date [Wed Jul 08 14:35:22 CDT 2015]; parent: org.springframework.context.annotation.AnnotationConfigApplicationContext@d960aca
2015-07-08 14:35:22.771  INFO 24408 --- [nio-8081-exec-1] s.c.a.AnnotationConfigApplicationContext : Closing org.springframework.context.annotation.AnnotationConfigApplicationContext@d960aca: startup date [Wed Jul 08 14:35:22 CDT 2015]; root of context hierarchy
do you see any issue? i am using spring cloud 1.0.2.RELEASE.

No, I don't.

How do you know the "bean value didn't change"?

I tested a bean method based (@Bean) and a annotated class (@Component) with @RefreshScope and somehow the method based variant did not call the constructor of the scoped bean after a "refreshAll" (org.springframework.cloud:spring-cloud-context:1.0.1.RELEASE).
If I am not wrong, I found the reason in "ConfigurationClassBeanDefinitionReader" (here: org.springframework:spring-context:4.1.6.RELEASE). In the method "loadBeanDefinitionsForBeanMethod" the metadata of the annotated bean is being resolved, with an attribute map containing "Bean", "RefreshScope" ({proxyMode -> TARGET_CLASS}) AND "Scope" ({value=refresh, proxyMode=DEFAULT}). Later (Line ~249) the proxyMode is being resolved for "Scope.class" (and a default of "ScopedProxyMode.NO"). So the RefreshScope is being ignored here, which leads to "refresh" not taking effect.
It only works with "@Scope(value = 'refresh', proxyMode = ScopedProxyMode.TARGET_CLASS)" at the bean method.
The "ClassPathBeanDefinitionScanner" uses a different approach with using a "ScopeMetadataResolver" for resolving scope metadata, which works.
Probably this behaviour should be changed in mentioned spring-context module.

Yes, spring-cloud-context is where this code lives, so it's better to open an issue there. I'm still not 100% sure I follow though because the constructor of any bean in @RefreshScope should only be called when the bean is needed (i.e. when a method is called). Maybe your @Component was being used in a different way than the @Bean. Anyway, can we move the discussion to spring-cloud-context please?

i am able to solve the issue by removing @autowired and using spring application context to directly get the bean, then i am able to get the new bean, some how with autowired annotation even though the cache is cleared some how it is getting the old bean from some place else, i will open a new issue in spring cloud context.

I just added a comment here: http://jira.spring.io/browse/SPR-13280 .


Fixed #32095 -- Made QuerySet.update_or_create() save only fields passed in defaults or with custom pre_save().

Extended from @apollo13 patch: https://github.com/django/django/pull/13526
Tried to address the PR comments which were to add handling for the auto_now fields and a test for the mti case.

@sarahboyce Thanks for this patch +1 Some comments from the original patch are not addressed:

https://github.com/django/django/pull/13526/files#r503304168
#13526 (comment)

Can you take a look?

Ah I missed these sorry!
Added some changes, I still need to have a think about the wastefulness part of this comment https://github.com/django/django/pull/13526#issuecomment-706707674

It feels kind of wasteful to compute that on every usage of save(update_fields) twice though.

I'll have a think, also happy for any suggestions :+1:

Thank you for picking up my old PR :)

I realise I will probably not be popular for adding freeze_gun into the testing requirements.
I was having that all tests except the windows runner tests were passing and I've had refactor the tests a bit to have the full suite pass, let me know if anyone has any suggestions :+1:

buildbot, test on oracle.


optimize chart dependency

Added dependance for optimize, keycloak and elastic

This is a helm chart for Camunda Platform 7, so I'm not sure why you want to add Camunda 8 services?

This is a helm chart for Camunda Platform 7, so I'm not sure why you want to add Camunda 8 services?

Optimize is also a camunda 7 service https://docs.camunda.io/optimize/self-managed/optimize-deployment/install-and-start/?_gl=1184tria_gaMjczODgxOTMwLjE2ODgxMTM5NjY._ga_4EYN8X5FNR*MTcxMDQxMDc2My4zNi4wLjE3MTA0MTA3NzEuNTIuMC4w#camunda-7-enterprise-stack
@paulhoot can you rebase your pr pls ? so I can review your pr


Better StorageBooter lock release approach

Task Description
At the moment StorageBooter.lockFile is acquired in the StorageBooter.initialize() method and released in the StorageBooter.removeLock() method. This is wrong because we have no guarantee that the lock will always be released (if the process stops unexpectedly for example). We need to improve it to release the lock in the finally block. Also we should use Hazelcast ILock as a lock type.
Useful Links

https://docs.hazelcast.org/docs/3.11/javadoc/com/hazelcast/core/ILock.html

Help

Our chat
Points of contact:

@carlspring
@fuss86
@sbespalov
@steve-todorov

Can I take this?

Sure @ykabusalah ! Feel free to pick it up :)

Go ahead :)

If @ykabusalah is not working on this can I take this issue

@TheKeySpammer : Feel free to pick it up! Thank you!

Pull request #1468


Replace handle.synchronize with new API

The scheduler has been de-scheduled: https://github.com/PolymerLabs/arcs/commit/ce05f2ef691672ec53cd0342c0c0f333b534a731


gnumake: fix occasional hangs in parallel builds

Motivation for this change
WARNING: This causes a mass rebuild.
GNU make 4.2.1, which is the most recent stable release, occasionally hangs (especially?) when doing parallel builds.
The included patch seems to fix the issue.
https://savannah.gnu.org/bugs/?49014
https://savannah.gnu.org/bugs/?51159
Things done

[X] Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)

[X] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[X] Tested execution of all binary files (usually in ./result/bin/)
[X] Fits CONTRIBUTING.md.

Nice, I have been suffering from (probably) that problem with kernel builds every now and then.

You explicitly use a jobserver?

No, but AFAIK 'jobserver' is just GNU make's internal term for the algorithm for managing build parallelism.

No, you can actually use an external job-server and I have considered doing that instead of -l.  Still, I suspect they internally use that to coordinate recursive make invocations.

Ah, the second issue mentions it happening during parallel recurse make.

In master and 17.09 now.


Paper is 25 (25 frames) but code is 26 (26x512).

In paper:
For example, an image containing 10 characters is typically of size 100 × 32, from which a feature sequence 25 frames can be generated.
In code:
model:add(cudnn.SpatialMaxPooling(2, 2, 1, 2, 1, 0)) -- 512x2x26
model:add(convRelu(7, true))                         -- 512x1x26
model:add(nn.View(512, -1):setNumInputDims(3))       -- 512x26
model:add(nn.Transpose({2, 3}))                      -- 26x512
Why in paper it's 25 but in code it's 26 ?

Hi @bgshih, first of all, BIG thanks for the work on CRNN and sharing your code.
As today when I was scanning thru your paper/code,
I noticed a minor difference about the unconventional pooling kernels:
< in paper >
the suggestion is to adopt a 2x1 (matrix format) pool kernel
< in code >
as shown above, it's implemented with normal 2x2 pool + stride 2x1
this is somehow related to what @SnailTyan is asking
TBH, since the code is working well, I guess it's just a minor adjustment
but curiosity drives me to search for an answer
Mind if you could share any thoughts about this?

Do either of you get the reason of this adjustment? I am also curious about it. If someone has any idea, please share your thoughts.:joy::joy::joy:


Not able to render 3d object using modelrenderable below minimum sdk version 24

SceneView can now be used instead of ArSceneView to render a scene when not using ARCore.
The camera can be moved and rotated via SceneView.getScene().getCamera().
The initial camera transform is currently not defined and likely to change in future releases. Make sure the camera position and orientation is set when the view is

I cant able to render 3d object with minimum sdk version 24
ModelRenderable.builder().setSource(this,Uri.parse("Icon_01.sfb"));

Hi can you give a bit more info.  What error are you seeing and what version are you running on?

MinSDKVersion : 21
Trying to use Sceneform ModelRenderable, but it shows error like this API needs min version 24

That is correct, version 3.1 of Sceneform requires CompletableFuture and OpenGL ES 3.1 which are not currently available in older SDK's than 24.   I'll open a feature request for supporting SDK version 21.

Hello.  Any updates on this feature request?  We would like to use SceneForm as a rendering engine without the AR components but we must support min SDK 21 and OpenGL ES 2.0

We also desperately need the support for min SDK 21...

We also desperately need the support for min SDK 21


docs: Fix typo in structures.md

Docs PRs are the best PRs of all. Thanks @manzt, nice to see you here.


Fail to launch container ubuntu 16.04 lxd 2.8 kernel 4.9

Required information

Distribution: lxd
Distribution version:2.8
The output of "lxc info" or if that fails:

Kernel version:4.9.8-040908-generic
LXC version:2.0.6
LXD version:2.8
Storage backend in use:

Issue description
Fail to launch container ubuntu 16.04 lxd 2.8 kernel 4.9
Steps to reproduce
lxd init
Name of the storage backend to use (dir or zfs) [default=dir]:
Would you like LXD to be available over the network (yes/no) [default=no]?
Would you like stale cached images to be updated automatically (yes/no) [default=yes]?
Would you like to create a new network bridge (yes/no) [default=yes]?
What should the new bridge be called [default=lxdbr0]?
What IPv4 address should be used (CIDR subnet notation, “auto” or “none”) [default=auto]?
What IPv6 address should be used (CIDR subnet notation, “auto” or “none”) [default=auto]?
error: The network already exists
root@kvm2g:~# dpkg-reconfigure -p medium lxd
Warning: Stopping lxd.service, but it can still be activated by:
lxd.socket
root@kvm2g:~# lxc launch ubuntu:16.04
Creating decent-giraffe
Starting decent-giraffe
error: Error calling 'lxd forkstart decent-giraffe /var/lib/lxd/containers /var/log/lxd/decent-giraffe/lxc.conf': err='exit status 1'
lxc<PHONE_NUMBER>0239.411 ERROR lxc_apparmor - lsm/apparmor.c:apparmor_process_label_set:220 - If you really want to start this container, set
lxc<PHONE_NUMBER>0239.411 ERROR lxc_apparmor - lsm/apparmor.c:apparmor_process_label_set:221 - lxc.aa_allow_incomplete = 1
lxc<PHONE_NUMBER>0239.411 ERROR lxc_apparmor - lsm/apparmor.c:apparmor_process_label_set:222 - in your container configuration file
lxc<PHONE_NUMBER>0239.411 ERROR lxc_sync - sync.c:__sync_wait:57 - An error occurred in another process (expected sequence number 5)
lxc<PHONE_NUMBER>0239.411 ERROR lxc_start - start.c:__lxc_start:1338 - Failedto spawn container "decent-giraffe".
lxc<PHONE_NUMBER>0239.942 ERROR lxc_conf - conf.c:run_buffer:347 - Script exited with status 1
lxc<PHONE_NUMBER>0239.942 ERROR lxc_start - start.c:lxc_fini:546 - Failed to run lxc.hook.post-stop for container "decent-giraffe".
Information to attach
dmesg
[13053.330564] lxdbr0: port 1(vethEIBP5W) entered blocking state
[13053.330566] lxdbr0: port 1(vethEIBP5W) entered disabled state
[13053.330644] device vethEIBP5W entered promiscuous mode
[13053.330753] IPv6: ADDRCONF(NETDEV_UP): vethEIBP5W: link is not ready
[13053.373039] eth0: renamed from veth8533XU
[13053.389219] IPv6: ADDRCONF(NETDEV_CHANGE): vethEIBP5W: link becomes ready
[13053.389277] lxdbr0: port 1(vethEIBP5W) entered blocking state
[13053.389279] lxdbr0: port 1(vethEIBP5W) entered forwarding state
[13053.409709] cgroup: new mount options do not match the existing superblock, will be ignored
[13053.512360] lxdbr0: port 1(vethEIBP5W) entered disabled state
[13053.514037] device vethEIBP5W left promiscuous mode
[13053.514042] lxdbr0: port 1(vethEIBP5W) entered disabled state
[13575.783964] audit: type=1400 audit(1486562559.279:48): apparmor="STATUS" operation="profile_load" name="lxd-decent-giraffe_</var/lib/lxd>" pid=12036 comm="apparmor_parser"
[13575.810036] lxdbr0: port 1(veth0KFO4L) entered blocking state
[13575.810038] lxdbr0: port 1(veth0KFO4L) entered disabled state
[13575.810161] device veth0KFO4L entered promiscuous mode
[13575.810333] IPv6: ADDRCONF(NETDEV_UP): veth0KFO4L: link is not ready
[13575.841380] eth0: renamed from vethTY7GXE
[13575.858068] IPv6: ADDRCONF(NETDEV_CHANGE): veth0KFO4L: link becomes ready
[13575.858106] lxdbr0: port 1(veth0KFO4L) entered blocking state
[13575.858107] lxdbr0: port 1(veth0KFO4L) entered forwarding state
[13575.960443] lxdbr0: port 1(veth0KFO4L) entered disabled state
[13575.962267] device veth0KFO4L left promiscuous mode
[13575.962269] lxdbr0: port 1(veth0KFO4L) entered disabled state
lxc info decent-giraffe --show-log
Log:
        lxc<PHONE_NUMBER>0239.410 WARN     lxc_apparmor - lsm/apparmor.c:apparmor_process_label_set:218 - Incomplete AppArmor support in your kernel
        lxc<PHONE_NUMBER>0239.411 ERROR    lxc_apparmor - lsm/apparmor.c:apparmor_process_label_set:220 - If you really want to start this container, set
        lxc<PHONE_NUMBER>0239.411 ERROR    lxc_apparmor - lsm/apparmor.c:apparmor_process_label_set:221 - lxc.aa_allow_incomplete = 1
        lxc<PHONE_NUMBER>0239.411 ERROR    lxc_apparmor - lsm/apparmor.c:apparmor_process_label_set:222 - in your container configuration file
        lxc<PHONE_NUMBER>0239.411 ERROR    lxc_sync - sync.c:__sync_wait:57- An error occurred in another process (expected sequence number 5)
        lxc<PHONE_NUMBER>0239.411 ERROR    lxc_start - start.c:__lxc_start:1338 - Failed to spawn container "decent-giraffe".
        lxc<PHONE_NUMBER>0239.942 ERROR    lxc_conf - conf.c:run_buffer:347- Script exited with status 1
        lxc<PHONE_NUMBER>0239.942 ERROR    lxc_start - start.c:lxc_fini:546- Failed to run lxc.hook.post-stop for container "decent-giraffe".
        lxc<PHONE_NUMBER>0239.942 WARN     lxc_commands - commands.c:lxc_cmd_rsp_recv:172 - command get_cgroup failed to receive response
        lxc<PHONE_NUMBER>0239.943 WARN     lxc_commands - commands.c:lxc_cmd_rsp_recv:172 - command get_cgroup failed to receive response

/var/log/lxd.log
bash: /var/log/lxd.log: No such file or directory

All my operation to a fresh install ubuntu 16.04
1
update to kernel 4.9
`wget http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.9/linux-headers-4.9.0-040900_4.9.0-040900.201612111631_all.deb
wget http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.9/linux-headers-4.9.0-040900-generic_4.9.0-040900.201612111631_amd64.deb
wget http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.9/linux-image-4.9.0-040900-generic_4.9.0-040900.201612111631_amd64.deb
sudo dpkg -i *.deb
sudo update-grub
sudo reboot`
2
enable bbr
sysctl net.core.default_qdisc=fq sysctl net.ipv4.tcp_congestion_control=bbr
enabled backports' repository enabled
vim /etc/apt/sources.list deb http://archive.ubuntu.com/ubuntu xenial-backports main restricted universe multiverse apt-get update apt-get upgrade
3
use the non-LTS branch of LXD on Ubuntu 16.04 LTS
apt install -t xenial-backports lxd lxd-client  apt install zfsutils-linux
4
lxd init
newgrp lxd
lxc launch ubuntu:
Then , problem occured.

It seems the network bridge lxdbr0 already existed and so the initial configuration of LXD did not complete successfully. Did you have LXD installed and initialized/used before?
The second issue about AppArmor support being incomplete is surprising though. Trying to reproduce this now.

@brauner after running "lxd init" , I didn't see the interface of setting the network(container's private ip , subnet etc.)
"AppArmor support being incomplete", I know nothing about this.

So what does ip addr show lxdbr0 say?

root@kvm2g:~# ip addr show lxdbr0
3: lxdbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
link/ether 00:00:00:00:00:00 brd ff:ff:ff:ff:ff:ff
inet <IP_ADDRESS>/24 scope global lxdbr0
valid_lft forever preferred_lft forever
inet6 fd42:e10e:f00a:adb0::1/64 scope global
valid_lft forever preferred_lft forever
inet6 fe80::5c9c:c0ff:feac:1633/64 scope link
valid_lft forever preferred_lft forever

Well actually, I don't think you issue is that surprising. You're downloading and installing a mainline vanilla v4.9 kernel. This also means that various (currently) Ubuntu-specific AppArmor patches have not been applied yet and so liblxc's complaint is perfectly sound. There's is nothing we can do about this until the AppArmor patches have made it into mainline. (Which is in progress I think.) Until then you can either try running on a patched v4.9 Ubuntu kernel or set lxc config set [<remote>:]<container> raw.lxc 'lxc.aa_allow_incomplete = 1'.

https://github.com/lxc/lxd/issues/2853
In this issue, somebody say lxd 2.8 runs well on kernel 4.9.
How can I manage to do it?

yes it works, I tested it on archlinux not in, ubuntu


Make ngserve System Specific

This PR modifies the honcho Procfile to run --poll=2000 conditionally if the user's computer uses Windows OS and runs just ng serve elsewhere.
@jadekeegan  / @briannata  / @atoneyd, feel free to test on Windows! It is working on my Mac.

@alshayefaziz, feel free to test too if you want! 😄


with Containerd , --docker-bridge-address  still required ?

When running AKS 1.19 with Ubuntu 18.04  and Containerd, is --docker-bridge-address  still required ?
https://docs.microsoft.com/en-us/azure/aks/configure-kubenet#create-an-aks-cluster-in-the-virtual-network :
The --docker-bridge-address lets the AKS nodes communicate with the underlying management platform. This IP address must not be within the virtual network IP address range of your cluster, and shouldn't overlap with other address ranges in use on your network.
https://docs.microsoft.com/en-us/azure/aks/configure-azure-cni#plan-ip-addressing-for-your-cluster :
Docker bridge address : | The Docker bridge network address represents the default docker0 bridge network address present in all Docker installations. While docker0 bridge is not used by AKS clusters or the pods themselves, you must set this address to continue to support scenarios such as docker build within the AKS cluster. It is required to select a CIDR for the Docker bridge network address because otherwise Docker will pick a subnet automatically which could conflict with other CIDRs. You must pick an address space that does not collide with the rest of the CIDRs on your networks, including the cluster's service CIDR and pod CIDR. Default of <IP_ADDRESS>/16. You can reuse this range across different AKS clusters.
see also https://docs.microsoft.com/en-us/answers/questions/124451/azure-cni-service-cidr-and-docker-bridge-cidr.html

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e1e42fdb-aa59-786b-ba0d-659f67db3cf3
Version Independent ID: cc199e1d-6737-5f52-f2a2-b6c0b603dbdc
Content: Cluster configuration in Azure Kubernetes Services (AKS) - Azure Kubernetes Service
Content Source: articles/aks/cluster-configuration.md
Service: container-service
GitHub Login: @palma21
Microsoft Alias: jpalma

@ezYakaEagle442 Thank you for your query. Our team will review and get back to you at the earliest.

No, that parameter is ignored for containerd. We'll update the documentation as soon as containerd GAs and it will eventually be removed and Moby is phased out.
cc @zr-msft

Thanks for bringing this to our attention. We will now close this issue. If there are further questions regarding this matter, please tag me in a comment. I will reopen it and we will gladly continue the discussion.

@Karishma-Tiwari-MSFT - I have installed aks 1.20.1 still I can see --docker-bridge-address is configured in kubernes in portal . How can we get rid of this in which version or process. ?

We still have validation in place for docker bridge that needs to be removed  fyi.

Hi team,
the parameter Docker bridge CIDR is still there. Any reason why it is still needed? What scenario will use docker build in cluster?
Thank you!


Memory Limits Problem

Hello~
I'm a master student in China , sorry for my poor English...
I was using your code with dataset provided in http://www.iis.ee.ic.ac.uk/rkouskou/research/6D_NBV.html
But there is a problem when run train_forest.sh ,
I strace the process and it seems that the process read all patches data into memory , and my computer has only 16G memory ...
I want to know that what is the basic hardware support  to run this code?
Thanks..

Unfortunately this is a limitation of the current Random Forest implementation. I used to train it on a workstation with 256GB of RAM, but generally it depends on how many objects/training patches you use.

Thanks... I think I should train it on a workstation too :)


Unexpected focus when closes tab.

Environment
Windows build number: Windows 10 Education 1903

I noticed tab focus issue when three or more tabs opened. If a tab different from the latest opened tab is closed, the terminal app will show two tabs as "active".
The two active tabs will not be gone until the wrong active tab is clicked on.

More specific repro steps:

open 3 tabs. (Screenshots are done with 4 tabs, to make the issue more apparent, but repros with 3 tabs)

with the 3rd selected, middle click the first, to close it.

Now, the 3rd tab is the second, and is focused. The old second tab is now the first tab.

click on the first tab to focus it. Both the first and second tabs will highlighted as if they're focused.

It's possible this is fixed by #1117

Unfortunately, #1117 does not fix this

I can't seem to repro this anymore?

This issue seems to be fixed the last time I checked.


Bump all images to most recent release

Description
@k4leung4 and I noticed the image tag default for the Fulcio chart is out of date. We should do a pass on all charts and make sure image tags are set to the most recent release.

@nsmith5 I think we bumped all the charts. I feel we could close this issue.

Yup agreed!


Resolve #107 - Correctly detect event name in OnEventStrategy

This change fixes an issue with OnEventStrategy not correctly
determining the event name if a custom event returns a message name
other than its own class name through the messageName() method.

Thank's for the PR.
First, there are some php-cs issues, see travis build.
Second, when you return "Result returned by messageName()" as message name, the invoked handler would be "onResult returned by messageName()", see https://github.com/prooph/service-bus/blob/master/src/Plugin/InvokeStrategy/OnEventStrategy.php#L42.
This means that when you return any message name as string containing illegal characters, like " ", "." and so son, the invoke method of the OnEventStrategy will fail.
Any ideas how to solve this? Perhaps a distinct OnEventStrategy is needed for this case. /cc @codeliner

@prolic I wasn't really aiming for a completely custom message name here, I used that string only for testing purposes. Just pushed a follow-up which fixes the CS issue and contains a more realistic message name.

@robertlemke My concern is not about if the message name is realistic or not, but that we need to make assumptions about it's name, that are not validated.

@prolic hmm, is this related to this bugfix then? If so, then I probably still don't understand what you mean.
For me, this PR was just about fixing the missing brackets in the ternary operator.

No it's not related to your bugfix. I need to clarify with @codeliner, as i
think we've found one more bug.
Am 05.02.2016 11:56 schrieb "Robert Lemke"<EMAIL_ADDRESS>
@prolic https://github.com/prolic hmm, is this related to this bugfix
then? If so, then I probably still don't understand what you mean.
For me, this PR was just about fixing the missing brackets in the ternary
operator.
—
Reply to this email directly or view it on GitHub
https://github.com/prooph/service-bus/pull/108#issuecomment-180319431.

Allright ;-)

@robertlemke @prolic I agree. The current implementation could lead to unexpected errors but is a separate issue to solve. I think this PR can be merged, right?


Develop use cases and wire frames for model program execution

Along with @Castronova and @goodalljl and myself.


[BUG] Index patterns in nested collection queries

What is the bug?
Using wildcards in index name works for simple queries only. Self-joined queries fail. More details in index-patterns-for-querying-nested-collection discussion:
How can one reproduce the bug?
Steps to reproduce the behavior:

Use sample data from:
https://opensearch.org/docs/latest/search-plugins/sql/sql/partiql/

Map array of object as nested type.

Query nested collection using index pattern employees* :

SELECT e.name AS employeeName,
       p.name AS projectName
FROM employees* AS e,
       e.projects AS p
WHERE p.name LIKE '%security%'

Result:
{
  "error": {
    "reason": "There was internal problem at backend",
    "details": "Index type [employees*] does not exist",
    "type": "IllegalArgumentException"
  },
  "status": 500
}

What is the expected behavior?
Search all indexes matching a given pattern
What is your host/environment?
2.6.0

@parked-toes Thanks for reporting the issue! I guess this is because the PartiQL in legacy engine doesn't support index pattern. Will take this into account when we migrate it to V2 engine.

w.r.t. AWS Opensearch service - Managed Cluster
I have verified that this issue can be re-produced with AWS Opensearch service version OS_2.x and later. It means that the below SQL query is working fine with AWS Opensearch service version OS_1.3 and lower :
SELECT e.name AS employeeName,
       p.name AS projectName
FROM employees* AS e,
       e.projects AS p
WHERE p.name LIKE '%security%'

The below steps were executed on AWS Opensearch service - Managed Cluster Version OS_2.3

Creating index with projects field with nested type

PUT employees_nested_test
{
  "mappings": {
    "properties": {
      "projects": {
        "type": "nested"
      }
    }
  }
}

Inserting sample data as mentioned in the documentation

POST employees_nested_test/_bulk?refresh
{"index":{"_id":"1"}}
{"id":3,"name":"Bob Smith","title":null,"projects":[{"name":"SQL Spectrum querying","started_year":1990},{"name":"SQL security","started_year":1999},{"name":"OpenSearch security","started_year":2015}]}
{"index":{"_id":"2"}}
{"id":4,"name":"Susan Smith","title":"Dev Mgr","projects":[]}
{"index":{"_id":"3"}}
{"id":6,"name":"Jane Smith","title":"Software Eng 2","projects":[{"name":"SQL security","started_year":1998},{"name":"Hello security","started_year":2015,"address":[{"city":"Dallas","state":"TX"}]}]}

querying data with index-name

POST /_plugins/_sql
{
  "query" : "SELECT e.name AS employeeName, p.name AS projectName FROM employees_nested_test AS e, e.projects AS p WHERE p.name LIKE '%security%'"
}

Output :
{
  "schema": [
    {
      "name": "name",
      "alias": "employeeName",
      "type": "text"
    },
    {
      "name": "projects.name",
      "alias": "projectName",
      "type": "text"
    }
  ],
  "total": 4,
  "datarows": [
    [
      "Jane Smith",
      "SQL security"
    ],
    [
      "Jane Smith",
      "Hello security"
    ],
    [
      "Bob Smith",
      "SQL security"
    ],
    [
      "Bob Smith",
      "OpenSearch security"
    ]
  ],
  "size": 4,
  "status": 200
}

Querying data with index-pattern employees*

POST /_plugins/_sql
{
  "query" : "SELECT e.name AS employeeName, p.name AS projectName FROM employees* AS e, e.projects AS p WHERE p.name LIKE '%security%'"
}

Output :
{
  "error": {
    "reason": "There was internal problem at backend",
    "details": "Index type [employees*] does not exist",
    "type": "IllegalArgumentException"
  },
  "status": 500
}

Executed Step 4 in AWS Opensearch service - Managed Cluster ES_7.10 & OS_1.3

POST /_plugins/_sql
{
  "query" : "SELECT e.name AS employeeName, p.name AS projectName FROM employees* AS e, e.projects AS p WHERE p.name LIKE '%security%'"
}

Got output as mentioned in Step 3.
Conclusion : AWS Opensearch service - Managed Cluster supports index-pattern till OS_1.3 but later version only supports index-name in SQL queries.

I am writing down simple reference to understand the behavior mentioned in this issue :
The below steps were confirmed on AWS Opensearch service - managed cluster [OS_2.3]
Working
POST /_plugins/_sql
{
  "query" : "SELECT name FROM employees*"
}

output :
{
  "schema": [
    {
      "name": "name",
      "type": "text"
    }
  ],
  "datarows": [
    [
      "Jane Smith"
    ],
    [
      "Susan Smith"
    ],
    [
      "Bob Smith"
    ]
  ],
  "total": 3,
  "size": 3,
  "status": 200
}

Not Working
POST /_plugins/_sql
{
  "query" : "SELECT e.name AS employeeName FROM employees* AS e"
}

output :
{
  "error": {
    "reason": "There was internal problem at backend",
    "details": "Index type [employees*] does not exist",
    "type": "IllegalArgumentException"
  },
  "status": 500
}


Use My Home Assistant link for HA add-on installation

Use Home Assistant as name (hass.io is no longer used)
Uses a My link to guide users to install the HA add-on.
Incorporated the changes from #283 too, and pointing it at the new repository.
Remove note about updating as it's just in the UI.

Fixes #283

Thanks!


Revoke reference tokens

Userstory;
As a developer, I want to be able to revoke a reference token so that it can no longer be used.
Acceptance criteria:

[ ] The developer must be authenticated to revoke the reference token.
[ ] The expiration date of the token must be set to the current date.
[ ] There must be a confirmation before the token can be removed.
[ ] The status of the reference token is set to "expired".

@NvanWeeghel I think we'll not only want the user to be authenticated to do this, but to also have authorization to perform the revoke action. For example, some users might be able to only see the available reference tokens, while others are also allowed to revoke them.

This was a translation error and has now been fixed


Upgrade for Gatsby v2 (onCreateWebpackConfig/setWebpackConfig)

As part of the Gatsby v2 upgrade, modifying the webpack config has received a new redux based api: https://next.gatsbyjs.org/docs/migrating-from-v1-to-v2/#change-modifywebpackconfig-to-oncreatewebpackconfig

@Creatiwity can you merge and publish this? I am using Gatsby 2 now and this plugin is broken. This would be a great fix!

Any reason why this PR is not being accepted? Would be great to have v2 compatibility.

Thank you for this PR. In fact I was busy and working on a last (big) update for Gatsby v1 but I didn't see that it was already in beta.
I will merge it in a feature branch tomorrow, release a last version on v1 without my current changes to speed everything up and publish this v2-based version shortly after.

@julien1619 Nice! Looking forward to it.

So I've merged it after fixing some conflicts, but I can't make it work with Gatsby v2. I can't say the exact error cause. Can you test it @JanoshRiebesell using the branch gatsby-v2 from this repository to see if you reproduce it? Thank you very much!
The error comes from favicons-webpack-plugin not finding webpack/lib/SingleEntryPlugin when building the site with Gatsby. It's the first I'm using Gatsby v2 so I don't know if it's Gatsby not exposing some dependency stuff, or favicons-webpack-plugin using webpack the wrong way, or simply my setup.
To test it you would need to pull this branch locally, and reimport favicons-webpack-plugin in it using the direct git link (a fix is available but not published yet). Thanks again!

Ok, so I've found it! Will be releasing this new version very soon with a lot of changes.

@julien1619 That's great! Let me know if I can help write docs for those changes if applicable.

Thanks @JanoshRiebesell, the big update is available ;)


Perfmon Log Translator

Hi,
I'm having some problems related to the language on the system. Looking at old codeplex I found people use to solve it with PLT but I cannot found it neither in the old nor new sites. Is the tool still available?

 Download the PLT zip file from there.
I have language translation planned in the next major version of PAL.
From: Chemaister<EMAIL_ADDRESS>Sent: Tuesday, July 17, 2018 1:44 AM
To: clinthuffman/PAL<EMAIL_ADDRESS>Cc: Subscribed<EMAIL_ADDRESS>Subject: [clinthuffman/PAL] Perfmon Log Translator (#21)
Hi,
I'm having some problems related to the language on the system. Looking at old codeplex I found people use to solve it with PLT but I cannot found it neither in the old nor new sites. Is the tool still available?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fclinthuffman%2FPAL%2Fissues%2F21&data=02|01|clinth%40microsoft.com|70928258ab4945b3b9c908d5ebc17a14|72f988bf86f141af91ab2d7cd011db47|1|0|636674138572757877&sdata=gl9JU%2BaC0WrDdd9Ujja7vmod6MZXn38fqeC42uOUDVc%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAS48VIke7wKgv4v7-RIgpgitQnSxj8w2ks5uHaPdgaJpZM4VSbNn&data=02|01|clinth%40microsoft.com|70928258ab4945b3b9c908d5ebc17a14|72f988bf86f141af91ab2d7cd011db47|1|0|636674138572767890&sdata=5wDS9tiuf2cfZzGTI9p6flgsf6sibRs56GxLvnpWlqU%3D&reserved=0.

Hi Clint,
Awesome, thanks! I'm still not proficient with powershell but for what is worth I can give support on testing next PAL for spanish.
Thanks!

Thanks. Yes, Spanish is the most commonly requested language. Thanks, but I already have full translation of most of the OS counters. The reports would be the only thing to have translated at this point.
From: Chemaister<EMAIL_ADDRESS>Sent: Thursday, July 19, 2018 11:32 PM
To: clinthuffman/PAL<EMAIL_ADDRESS>Cc: Clint Huffman<EMAIL_ADDRESS>Comment<EMAIL_ADDRESS>Subject: Re: [clinthuffman/PAL] Perfmon Log Translator (#21)
Hi Clint,
Awesome, thanks! I'm still not proficient with powershell but for what is worth I can give support on testing next PAL for spanish.
Thanks!
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fclinthuffman%2FPAL%2Fissues%2F21%23issuecomment-406502612&data=02|01|clinth%40microsoft.com|6eeda4ec2f524d06dcbd08d5ee0a8ddf|72f988bf86f141af91ab2d7cd011db47|1|0|636676651456171290&sdata=kkMANdavE%2BzXhv0W2yxjSv0%2BXDEls7LoLlFCPuMLcnc%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAS48VL6gzIuZiltmAC6cw3u0jiEb9l0-ks5uIXl3gaJpZM4VSbNn&data=02|01|clinth%40microsoft.com|6eeda4ec2f524d06dcbd08d5ee0a8ddf|72f988bf86f141af91ab2d7cd011db47|1|0|636676651456171290&sdata=upD%2Byi3uTyldJYqN1dvdCpsa0vOj7q%2FdZzN8weHsRgw%3D&reserved=0.


Adds SecurePort parameterization

Introduces a SecurePort int field to the MicroshiftConfig struct which is used to set the secure port that the API server binds to. This port can either be set through the CLI using --secure-port, through the MICROSHIFT_SECUREPORT environment variable, or the securePort attribute in the config file.
Additionally, since ClusterConfig contains the URL which the cluster runs on, a ConfigureClusterURL method is added to Microshift which inserts the provided SecurePort into the ClusterConfig.URL field.
Which issue(s) this PR addresses:

Closes #142

/ok-to-test

/approve

/retest

@rootfs @osilkin98 what do we want to do with this PR? Should we move forward or is it covered by Franks change

@cooktheryan discussed with @osilkin98 to convert to a doc PR, detailing how to use config to map out different URL and ports

@osilkin98 Please have a look into this. We need to rebase and merge. Thanks

/test e2e-rpm-install
/test e2e-openshift-conformance-sig-instrumentation

/lgtm


video versioned of this template.

hello friend, is it possible you can make another theme based on vredeburg but for video. which looks like this, i want to share anime and i want to display 4 small thumbs on the front page with tags .

Hmm... you can change the code in src / _includes / partials / post-grid.njk
But why do you need 4 thumbnails for each anime?

Hmm... you can change the code in src / _includes / partials / post-grid.njk
But why do you need 4 thumbnails for each anime?

thanks i figured it out, now i just need to change the css, i want to show different times in video with 4 thumbnails it is just something i like to do it is nothing specific.
thanks


Command to set PHP environment variables

Ability to create PHP environment variables (if PHP is installed during configure). This will either be during configure, site:create, and/or with a unique command.
Before deciding variables, the user will be prompted with an option of how they want to store these environment variables. This may be either:

Store in cdev/docker-compose.yml (Docker Compose)
Store in src/.env (Environment file, recommended with Creode Boilerplate)
Store in ~/.bash_profile (local Bash file)

The request makes sense but the last 2 options don't. We should put the variables into cdev/docker-compose.yml so that they're part of the environment when it's booted

This should now be in the docker environment plugin repo - https://github.com/creode/cdev-environment-docker/issues


[release-1.26] 16k kernel page builds to support Apple Silicon (ARM64)

Backport #7335

Closing per this comment and approval from MGMT
https://github.com/k3s-io/k3s/issues/7335#issuecomment-1529916982


Mac OS Support

This library does not works on Mac OS

The Chroma SDK does not support Mac OS and Razer have no plans to add support, so sadly this will never happen.


Add mushroom dataset

This pull request implements mushroom dataset to resolve #12

Thanks for the review and additional changes. Agreed not to use eval as much as possible. Using CONVERTERS hash looks good to me.


Can't connect after adding access on mainnet

Description

Needs some investigation

Version information

OS: Ubuntu 20.04
project commit/version: latest development
Browser: chrome 84

Steps to reproduce

Deploy any solution from local marketplace on mainnet
Add access to the apps network
Try to connect to the solution it won't connect

Delete the apps network
print the wg configs during deployment at: https://github.com/threefoldtech/js-sdk/blob/ef00a2dea91ef5629ba11c486c347ccc6f350841/jumpscale/sals/marketplace/apps_chatflow.py#L168
use that wireguard to access the solution it will access normally

was ISB problem


Add Theme AMOLEDblue analogue DarkBlue

This looks visually terrible

I like the dark blue theme, but also lack the Amoled/Black in it

This looks visually terrible

I would so Black-Red called the already existing in the application

Both are ugly and don't belong in the app


triage gosec report:  (CWE-118): Implicit memory aliasing in for loop.

(This is not a security issue!)

[ ] control-plane/components/kyma-environment-broker/internal/runtime/handler.go:173:17
https://github.com/kyma-project/control-plane/pull/2130

https://github.com/securego/gosec linter reports following potential bugs that can lead to unintended behaviour. The findings need to be manually validated as there might be false positives.
run gosec ./... on /control-plane/components/kyma-environment-broker to reproduce.

[/Users/tillknuesting/control-plane/components/kyma-environment-broker/internal/orchestration/handlers/converter.go:30] - G601 (CWE-118): Implicit memory aliasing in for loop. (Confidence: MEDIUM, Severity: MEDIUM)
    29:         for _, o := range orchestrations {
  > 30:                 status, err := c.OrchestrationToDTO(&o, nil)
    31:                 if err != nil {

Seem to be all false positives as in the loop the address is passed into a downstream method that allocates.


Update qtox.rb

Please squash your commits, and update the commit message from the generic GH message.

Done.


ui-sref-active can only apply a class

I'd like to be able to add/remove/alter an attribute as well. The use case is to add an aria-selected attribute and have it set to true/false depending on whether the view is selected or not. So, similar to ui-sref-active but for attributes.
This could perhaps work similar to ng-attr-*.

+1

I've too run into this problem today. I figured it'd be easy to model this directive off the existing UISrefActive, but its seeming like SrefStatus is something I cant inject into my external directive... has anyone been able to find a workaround for even if this element that has uiSref directive applied is current or anything like that?


What skills are needed to contribute?

So far I am using React-SketchApp and learning Reactjs, React-primitives and Styled-components. If I wanted to contribute to the repo would I need to learn Nodejs and is that creating the node_modules folder? Is there anything else to learn?

It depends what you want to contribute to.
A lot can be done by fixing or creating examples without requiring too much knowledge about react renderers, sketch plugins, and such obscure things:

#192
#191
#176

I've seen that you also help others fix their issues, that's the best form of contribution!

OK, good point. I'll try contribute this way.


LibWeb: Store CSS color name in CSSRGB

When serializing an sRGB color value that originated from a named color, it should simply return the color name. This requires storing the color name (if it has one).
This fixes 2 WPT subtests of https://wpt.fyi/results/domparsing/style_attribute_html.html?label=master&product=ladybird.
This is the easiest way I could find to store the original color name, though there is also the option of storing an enum.

The rest of the "failing" tests were actually correct, the expected output just had to be updated.


Adding a Windows node fails on latest Azure WindowsServer 2019-Datacenter-with-Containers images

What kind of request is this (question/bug/enhancement/feature request):
Bug
Steps to reproduce (least amount of steps as possible):

Create a custom windows cluster
Create a VM on Azure with the latest WindowsServer 2019-Datacenter-with-Containers image
Run the join agent command on the Windows VM

Result:

The node should be added to the cluster.

Error message:
INFO: Detecting running permission ...
INFO: Detecting host CPU reservation ...
INFO: Detecting host RAM reservation ...
INFO: Detecting host DISK reservation ...
INFO: Detecting host Docker name pipe existing ...
INFO: Detecting host Docker release version ...
FATA: Only support with Docker EE

Other details that may be helpful:
The image comes with a docker container runtime pre-installed.  The version is now reported as Mirantis Container Runtime instead of Docker Enterprise:
 docker version
Client: Mirantis Container Runtime
 Version:           19.03.13
 API version:       1.40
 Go version:        go1.13.15
 Git commit:        0c38b2d
 Built:             11/12/2020 21:33:08
 OS/Arch:           windows/amd64
 Experimental:      false

Server: Mirantis Container Runtime
 Engine:
  Version:          19.03.13
  API version:      1.40 (minimum version 1.24)
  Go version:       go1.13.15
  Git commit:       5b5efb2d49
  Built:            11/12/2020 21:31:44
  OS/Arch:          windows/amd64
  Experimental:     false

Because of that, this check in the Windows bootstrap script does not work anymore: https://github.com/rancher/rancher/blob/8a14c935aa3b573c437ea04d89843332228dc471/package/windows/bootstrap.ps1#L173-L177
Environment information

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI): 2.5.2
Installation option (single install/HA): HA

Cluster information

Cluster type (Hosted/Infrastructure Provider/Custom/Imported): Custom with Windows support
Machine type (cloud/VM/metal) and specifications (CPU/memory): Azure, latest WindowsServer 2019-Datacenter-with-Containers image
Kubernetes version (use kubectl version): v1.18.12
Docker version (use docker version): Mirantis Container Runtime 19.03.13

Just noticed, that there is already a fix for this in the 2.5 branch, which is not (yet?) in master: https://github.com/rancher/rancher/commit/670f21c6d50e5dba80f9576cd7c6361fa6c2eda5#diff-699f8fb88e10460b51809d18260b3cf61f3d95d48dcea54cf9ebddc70bd5e638.

Duplicate of https://github.com/rancher/rancher/issues/30148


issue-16 shift subtitle segments to the start of frames

Codecov Report

Merging #17 into development will decrease coverage by 0.11%.
The diff coverage is 95.34%.

@@               Coverage Diff               @@
##           development      #17      +/-   ##
===============================================
- Coverage        90.14%   90.02%   -0.12%
===============================================
  Files               12       12
  Lines              984     1023      +39
===============================================
+ Hits               887      921      +34
- Misses              97      102       +5

Impacted Files
Coverage Δ

subaligner/predictor.py
89.21% <100%> (-0.55%)
:arrow_down:

subaligner/embedder.py
90.99% <100%> (-0.09%)
:arrow_down:

subaligner/media_helper.py
92.41% <92%> (-0.09%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7257e80...5d9f33c. Read the comment docs.


Bump docker package to v25.0.6 to fix critical CVE GHSA-v23v-6jw2-98fq

Fixes a critical CVE found in the docker/docker package:
https://github.com/moby/moby/security/advisories/GHSA-v23v-6jw2-98fq
This is a minor z-stream bump that should not introduce a regression. There's an existing bot PR that is bumping the same package to 26.1.4 (https://github.com/operator-framework/operator-sdk/pull/6794), but this version still contains the bug as per advisory. It would be better to use version 26.1.5, which has the fix for this bug.

Closing since the below moved this to v27.x.x

Relates: #6823


Remove duplicate likes and send username with comment

Remove duplicate likes
send username with comment
Make authors/<author_id>/posts/ return appropriate posts depending on who the signed in user is


Re-add bank account

This PR re-adds the previous bank-account exercise with an updated
test suite. The previous test suite had a call to (shutdown-agents)
outside of a function body, which caused it to get called before all
tests had executed. This version of the test suite uses a fixture to
ensure that the (shutdown-agents) call happens after all tests have
executed.

Thanks for doing this! Looks like Travis is pleased too :smile:

Thanks!


Add option to assume role

Feature request
Ability to Assume role by default by main container.
This would be equivalent to first doing:
aws sts assume-role --role-arn arn:aws:iam::123456789012:role/xaccounts3access
and using the generated credentials to use aws resources.

It wouldn't be feasible to have workflows act as the aws metadata server for the main container (similar to KIAM). I think the best we can do is to have a convenience input artifact type, awsCredentials, which will perform the sts-assume-role and place the generated credentials in file which is easily consumed by AWS SDKs like boto. Example below:
apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
  generateName: aws-assume-role-
spec:
  entrypoint: aws-assume-role
  templates:
  - name: aws-assume-role
    inputs:
      artifacts:
      - name: my-aws-credentials
        path: /root/.aws/credentials
        awsCredentials:
          assumeRoleARN: role:1l23123:1231312312
    container:
      image: debian:latest
      command: [sh, -c]
      args: ["ls -l /my-artifact"]

@mehtadeepen We're moving to the new IAM Roles for serviceAccounts functionality.
It's reasonably straightforward to associate a K8s serviceAccount with an AWS IAM role, and then you don't need to the sts assume-role at all if you're application is using newer versions of AWS's SDKs that support it.
Would this satisfy your needs?

It wouldn't be feasible to have workflows act as the aws metadata server for the main container (similar to KIAM). I think the best we can do is to have a convenience input artifact type, awsCredentials, which will perform the sts-assume-role and place the generated credentials in file which is easily consumed by AWS SDKs like boto. Example below:
apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
  generateName: aws-assume-role-
spec:
  entrypoint: aws-assume-role
  templates:
  - name: aws-assume-role
    inputs:
      artifacts:
      - name: my-aws-credentials
        path: /root/.aws/credentials
        awsCredentials:
          assumeRoleARN: role:1l23123:1231312312
    container:
      image: debian:latest
      command: [sh, -c]
      args: ["ls -l /my-artifact"]

It wouldn't be feasible to have workflows act as the aws metadata server for the main container (similar to KIAM). I think the best we can do is to have a convenience input artifact type, awsCredentials, which will perform the sts-assume-role and place the generated credentials in file which is easily consumed by AWS SDKs like boto. Example below:
apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
  generateName: aws-assume-role-
spec:
  entrypoint: aws-assume-role
  templates:
  - name: aws-assume-role
    inputs:
      artifacts:
      - name: my-aws-credentials
        path: /root/.aws/credentials
        awsCredentials:
          assumeRoleARN: role:1l23123:1231312312
    container:
      image: debian:latest
      command: [sh, -c]
      args: ["ls -l /my-artifact"]

Probably you will also need to add refresh time for long running steps. As sts can get you credentials just for 3600 seconds.

As sts can get you credentials just for 3600 seconds.

It can get you credentials for up to 12hrs, if the role you're getting creds for allows the full 12hrs. If not, you can get the max allowed by the role.

@sarabala1979 mentioned this possible solution. Would this work?
apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
  generateName: aws-assume-role-
spec:
  entrypoint: aws-assume-role
  templates:
  - name: aws-assume-role
    inputs:
      artifacts:
      - name: aws-config
        path: /root/.aws/config
        raw:
          data: |
            [profile default]
            role_arn = role:1l23123:1231312312
    container:
      image: debian:latest
      command: [sh, -c]
      args: ["ls -l /my-artifact"]

We're moving to the new IAM Roles for serviceAccounts EKS functionality.

@thundergolfer is there somewhere this effort is being tracked that I can follow?

@cludden by "we" I mean my company.

@thundergolfer thanks for clarifying. out of curiousity, were you able to get it to work for artifacts?

@cludden  Haven't tried with Argo's artifacts functionality.

@sarabala1979 This worked for me .. !! 👍
kind: Workflow
metadata:
  generateName: aws-assume-role-
spec:
  entrypoint: aws-assume-role
  templates:
  - name: aws-assume-role
    inputs:
      artifacts:
      - name: aws-config
        path: /root/.aws/config
        raw:
          data: |
            [profile default]
            role_arn = role:1l23123:1231312312
    container:
      image: debian:latest
      command: [sh, -c]
      args: ["ls -l /my-artifact"]```

Using temporary STS credentials will be supported in #12467


Warning messages on import

When importing with import BackgroundService from 'react-native-background-actions'; , metro shows the following warnings :

new NativeEventEmitter() was called with a non-null argument without the required addListener method.

new NativeEventEmitter() was called with a non-null argument without the required removeListeners method.

I use react-native v0.66.0 and react-native-background-actions v2.6.4

It works, thank you.


Publish new versions to npm.

https://www.npmjs.com/package/sass-loader
Seems like 1.0.0 hasn't been published.

My bad.
▶ npm view sass-loader
{ name: 'sass-loader',
description: 'Sass loader for webpack',
'dist-tags': { latest: '0.6.0' },
versions:
[ '0.0.1',
'0.0.2',
'0.1.0',
'0.1.1',
'0.2.0',
'0.3.0',
'0.3.1',
'0.4.0-beta.1',
'0.4.0',
'0.4.1',
'0.4.2',
'0.5.0',
'0.6.0',
'1.0.0',
'1.0.1' ],

My bad.
▶ npm view sass-loader
{ name: 'sass-loader',
description: 'Sass loader for webpack',
'dist-tags': { latest: '0.6.0' },
versions:
[ '0.0.1',
'0.0.2',
'0.1.0',
'0.1.1',
'0.2.0',
'0.3.0',
'0.3.1',
'0.4.0-beta.1',
'0.4.0',
'0.4.1',
'0.4.2',
'0.5.0',
'0.6.0',
'1.0.0',
'1.0.1' ],

No problem. 0.6.0 is actually the latest version that has been published. But that was a compatibility fix for an older version.


How does WMAgent handle job exceeding requested memory?

Last week a lot of nodes went down because of jobs exceeding the requested memory. How WMAgent handles such situation? Does it kill the job immediately or let it goes above certain soft limit?
On a side note, @juztas realized there are many jobs asking for memory of -400? Do we know what it means / how the process is handled?
$ condor_q -g -const 'RequestMemory<MemoryUsage' -af WMAgent_RequestName RequestMemory MemoryUsage | sort | uniq -c | grep -v undefined
      1 pdmvserv_task_B2G-RunIIAutumn18NanoAOD-00125__v1_T_190203_055357_6674 1000 1221
      3 pdmvserv_task_B2G-RunIIFall17MiniAODv2-00240__v1_T_181009_185258_1840 1000 1221
      1 pdmvserv_task_BPH-RunIIFall17GS-00116__v1_T_181124_133831_2613 10000 12208
      3 pdmvserv_task_BPH-RunIIFall17GS-00116__v1_T_181124_133831_2613 -400 2198
      1 pdmvserv_task_BPH-RunIIFall17GS-00116__v1_T_181124_133831_2613 -400 2930
      1 pdmvserv_task_BPH-RunIIFall17GS-00124__v1_T_181212_135543_3681 -400 2198
      1 pdmvserv_task_BPH-RunIIFall18GS-00072__v1_T_181124_134811_5473 -400 2198
      1 pdmvserv_task_EXO-RunIISummer16NanoAODv4-00186__v1_T_190203_005045_6435 1000 1465
      1 pdmvserv_task_HIG-PhaseIIMTDTDRAutumn18wmLHEGS-00002__v1_T_190130_121604_9641 10000 12208

For the first question, we only poll the resources being used once every 5min, so there could be a spike of resources consumption in between which the job watchdog would not see.
For those jobs requesting -400MB of memory. I picked one job sitting in Held status in submit8 and investigated its classads, there are multiple problems like:

WMCore does not protect against negative resource requests
Unified is changing the default WMCore values for resizable jobs
HTCondor does not seem to respect MinCores. This is probably the root cause for these problems.

Here is the fulll job classad:
http://amaltaro.web.cern.ch/amaltaro/forWMCore/Issue_8992/21889.141
with special attention to
OriginalMemory = 8000
RequestMemory = OriginalMemory + ExtraMemory * (WMCore_ResizeJob ? (RequestCpus - OriginalCpus) : 0)
ExtraMemory = 1200
WMCore_ResizeJob = true
RequestCpus = WMCore_ResizeJob ? ( !isUndefined(Cpus) ? RequestResizedCpus : JobCpus) : OriginalCpus
OriginalCpus = 8
RequestResizedCpus = (Cpus > MaxCores) ? MaxCores : ((Cpus < MinCores) ? MinCores : Cpus)
JobCpus = ((JobStatus =!= 1) && (JobStatus =!= 5) &&  !isUndefined(MATCH_EXP_JOB_GLIDEIN_Cpus) && (int(MATCH_EXP_JOB_GLIDEIN_Cpus) =!= error)) ? int(MATCH_EXP_JOB_GLIDEIN_Cpus) : OriginalCpus
MATCH_EXP_JOB_GLIDEIN_Cpus = "1"
MinCores = 3
MaxCores = 15
MATCH_Cpus = 1

Bottom line is, I'm not sure there is anything to be done within WMCore...

@amaltaro we just checked and many of them remain not killed. Their memory usage did not decrease (based on HTCondor Classads, so maybe Watchdog monitors differently?).
For example:
condor_q -g -const 'WMAgent_RequestName=?="pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022" && MemoryUsage>6000 && JobStatus=?=2' -af ClusterId ProcId WMAgent_RequestName RequestMemory MemoryUsage "JobCurrentStartDate-time()"
   1 31963 111 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -151604
   2 32026 154 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -151599
   3 32030 95 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -31230
   4 32089 112 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -25768
   5 32091 48 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -8373
   6 32091 54 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -8335
   7 32091 72 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -23449
   8 32091 99 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -8332
   9 32091 143 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -23445
  10 32091 144 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -23445
  11 32091 167 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -8331
  12 32091 174 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -23440
  13 32091 183 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -23439
  14 32091 184 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -8299

After more than 10 mins, they stay in Running State and their time increased. (Maybe HTCondor does not get updated memory usage?). See below:
   1 31963 111 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -152673
   2 32026 154 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -152668
   3 32030 95 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -32299
   4 32089 112 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -26837
   5 32091 48 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -9442
   6 32091 54 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -9404
   7 32091 72 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -24518
   8 32091 99 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -9401
   9 32091 143 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -24514
  10 32091 144 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -24514
  11 32091 167 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -9400
  12 32091 174 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -24509
  13 32091 183 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 9766 -24508
  14 32091 184 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00274__v1_T_190121_150334_5022 2000 7325 -9368

Also, If you check wmstats page, there are none with 50660 exit code for this workflow.

@amaltaro Just for clarification, Justas' message was referring to the 5 minute poll frequency. It would be great if you can double check whether the agent kills those jobs right away when it sees the memory consumption excess or there are some other conditions. Those jobs took down a lot of worker nodes.

Justas, Thong, any chance these jobs are running at Caltech and you can look at their logs file on the worker node (probably wmagentJob.log file)?
We had a standing issue that got fixed recently (still not in production):
https://github.com/dmwm/WMCore/issues/8345
which might let jobs running for longer than it should (trying only SIGUSR2).

I am closing this issue, as this does not seem as WMAgent issue. Please see some debug details below and few comments:
a) Find out which jobs are out of memory now (based on htcondor):
[jbalcas@vocms025 ~]$ condor_q -pool vocms0815.cern.ch -g -const 'WMAgent_RequestName isnt undefined && MATCH_GLIDEIN_CMSSite=?="T2_US_Caltech" && MemoryUsage>RequestMemory && JobStatus=?=2' -af ClusterId ProcId WMAgent_RequestName ProportionalSetSizeKb ResidentSetSize ImageSize RequestMemory MemoryUsage RemoteHost
13959 89 pdmvserv_task_TOP-RunIIFall17wmLHEGS-00279__v1_T_190121_150344_9094 7500000 7500000 12500000 5000 7325 slot1_8<EMAIL_ADDRESS>173666 105 pdmvserv_task_B2G-RunIIFall18wmLHEGS-00352__v1_T_190210_045500_7510  12500000 12500000 20000000 11100 12208 slot1_2<EMAIL_ADDRESS>
-- Failed to fetch ads from: <<IP_ADDRESS>:4080?addrs=<IP_ADDRESS>-4080&noUDP&sock=8496_20b8_83> : vocms0137.cern.ch
SECMAN:2007:Failed to end classad message.

So based on this 2 jobs are exceeding memory. looking at compute-11n-2.
b) From WN:
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
nobody   36868  0.0  0.0   9900  1276 ?        S    Feb12   0:00      |       \_ /bin/bash /wntmp/condor/execute/dir_29199/glide_srffF3/main/condor_startup.sh glidein_config
nobody   38003  0.0  0.0  98560  6600 ?        Ss   Feb12   0:02      |           \_ /wntmp/condor/execute/dir_29199/glide_srffF3/main/condor/sbin/condor_master -f -pidfile /wntmp/condor/execute/dir_29199/glide_srffF3/condor_master2.pid
nobody   38025  6.3  0.0  31392 10612 ?        S    Feb12 177:51      |               \_ condor_procd -A /wntmp/condor/execute/dir_29199/glide_srffF3/log/procd_address -L /wntmp/condor/execute/dir_29199/glide_srffF3/log/ProcLog -R 1000000 -S 60 -C 99
nobody   38027  0.3  0.0 101184  9164 ?        Ss   Feb12   9:37      |               \_ condor_startd -f
nobody   23440  0.0  0.0  98756  8132 ?        Ss   Feb13   0:02      |                   \_ condor_starter -f -a slot1_2 cmsgwms-submit3.fnal.gov
nobody   27979  0.0  0.0   5732   660 ?        Ss   Feb13   0:00      |                       \_ /usr/libexec/singularity/bin/action-suid /srv/.osgvo-user-job-wrapper.sh /srv/condor_exec.exe pdmvserv_task_B2G-RunIIFall18wmLHEGS-00352__v1_T_190210_045500_7510-Sandbox
.tar.bz2 6321522
nobody   28091  0.0  0.0   6972   620 ?        S    Feb13   0:00      |                           \_ shim-init                                /srv/.osgvo-user-job-wrapper.sh /srv/condor_exec.exe pdmvserv_task_B2G-RunIIFall18wmLHEGS-00352__v1_T_190210_045500_7510-San
dbox.tar.bz2 6321522
nobody   28092  0.0  0.0  11484   308 ?        S    Feb13   0:00      |                               \_ /bin/bash /srv/condor_exec.exe pdmvserv_task_B2G-RunIIFall18wmLHEGS-00352__v1_T_190210_045500_7510-Sandbox.tar.bz2 6321522
nobody   28835  0.1  0.0<PHONE_NUMBER>8 ?        Sl   Feb13   0:20      |                                   \_ python2 Startup.py
nobody   31455  0.0  0.0  11736   660 ?        S    Feb13   0:00      |                                       \_ /bin/bash /srv/job/WMTaskSpace/cmsRun1/cmsRun1-main.sh  slc6_amd64_gcc700 scramv1 CMSSW CMSSW_10_2_5 FrameworkJobReport.xml cmsRun PSet.py
nobody   31554  229  5.3 13461884 6989172 ?    Sl   Feb13 725:16      |                                           \_ cmsRun -j FrameworkJobReport.xml PSet.py

So cmsRun VSZ is 13.4Gb; RSS is 6.9, while HTCondor MemoryUsage and or ResidentSetSize is around 12GB (and remains for the time I was checking)
c) Checking Watchdog:
2019-02-14 08:09:17,038:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 08:09:17,039:INFO:PerformanceMonitor:RSS: 6982836;  VSize: 13461884; PCPU: 237; PMEM: 5.3
2019-02-14 08:14:17,066:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 08:14:17,066:INFO:PerformanceMonitor:RSS: 6935640;  VSize: 13461884; PCPU: 236; PMEM: 5.2
2019-02-14 08:19:17,093:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 08:19:17,094:INFO:PerformanceMonitor:RSS: 6922176;  VSize: 13461884; PCPU: 235; PMEM: 5.2
2019-02-14 08:24:17,118:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 08:24:17,118:INFO:PerformanceMonitor:RSS: 6984616;  VSize: 13461884; PCPU: 234; PMEM: 5.3
2019-02-14 08:29:17,166:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 08:29:17,166:INFO:PerformanceMonitor:RSS: 6964308;  VSize: 13461884; PCPU: 233; PMEM: 5.2
2019-02-14 08:34:17,197:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 08:34:17,198:INFO:PerformanceMonitor:RSS: 6937216;  VSize: 13461884; PCPU: 232; PMEM: 5.2
2019-02-14 08:39:17,232:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 08:39:17,232:INFO:PerformanceMonitor:RSS: 6980644;  VSize: 13461884; PCPU: 232; PMEM: 5.2
2019-02-14 08:44:17,266:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 08:44:17,266:INFO:PerformanceMonitor:RSS: 6923632;  VSize: 13461884; PCPU: 231; PMEM: 5.2
2019-02-14 08:49:17,292:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 08:49:17,293:INFO:PerformanceMonitor:RSS: 6956172;  VSize: 13461884; PCPU: 230; PMEM: 5.2
2019-02-14 08:54:17,321:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 08:54:17,322:INFO:PerformanceMonitor:RSS: 6958384;  VSize: 13461884; PCPU: 230; PMEM: 5.2
2019-02-14 08:59:17,347:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 08:59:17,348:INFO:PerformanceMonitor:RSS: 6899800;  VSize: 13461884; PCPU: 229; PMEM: 5.2
2019-02-14 09:04:17,376:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 09:04:17,376:INFO:PerformanceMonitor:RSS: 6980340;  VSize: 13461884; PCPU: 228; PMEM: 5.2
2019-02-14 09:09:17,400:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 09:09:17,401:INFO:PerformanceMonitor:RSS: 6909228;  VSize: 13461884; PCPU: 228; PMEM: 5.2
2019-02-14 09:14:17,432:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 09:14:17,432:INFO:PerformanceMonitor:RSS: 6871240;  VSize: 13461884; PCPU: 226; PMEM: 5.2
2019-02-14 09:19:17,470:INFO:PerformanceMonitor:Retrieved following performance figures:
2019-02-14 09:19:17,470:INFO:PerformanceMonitor:RSS: 7031072;  VSize: 13461884; PCPU: 226; PMEM: 5.3

So the biggest what it saw was a bit over 7GB. (Maybe there was a small peak, but average is 7Gb). So going through HTCondor documentation:
This is what is in the job classads:
MemoryUsage = ifthenelse(ProportionalSetSizeKb =?= undefined,( ResidentSetSize + 1023 ) / 1024,( ProportionalSetSizeKb + 1023 ) / 1024)

MemoryUsage:
An integer expression in units of Mbytes that represents the peak memory usage for the job. Its purpose is to be compared with the value defined by a job with the request_memory submit command, for purposes of policy evaluation.
ImageSize:
Maximum observed memory image size (i.e. virtual memory) of the job in Kbytes. The initial value is equal to the size of the executable for non-vm universe jobs, and 0 for vm universe jobs. When the job writes a checkpoint, the ImageSize attribute is set to the size of the checkpoint file (since the checkpoint file contains the job's memory image). A vanilla universe job's ImageSize is recomputed internally every 15 seconds. How quickly this updated information becomes visible to condor_q is controlled by SHADOW_QUEUE_UPDATE_INTERVAL and STARTER_UPDATE_INTERVAL.
ResidentSetSize:
Maximum observed physical memory in use by the job in Kbytes while running.
ProportionalSetSizeKb:
Maximum observed physical memory in use by the job in Kbytes while running.
On Linux execute machines with kernel version more recent than 2.6.27, this is the maximum observed proportional set size (PSS) in Kbytes, summed across all processes in the job.

So it will always be a PEAK reached in some range in which htcondor gets this information.
Now where I see a problem, but it is just from my point of view:
MemoryUsage is only reported as a peak. Maybe htcondor could have like 3 values: min,max,avg and for a few time ranges: 30min, 1h, allruntime? Not sure if this is even possible or doable.
Unified uses this value (MemoryUsage) to change the next jobs RequestMemory and would be interesting to see if Unified already modified RequestMemory for this job (did not save all classads and job is gone now, not sure which schedd it was, but ClusterID, ProcID is known). If so, then RequestMemory was overcommitted by more than 4gb. Would it affect matchmaking and filling the slots?
Another not an issue, but would be great if Watchdog could do condor_chirp of RSS Usage. Or maybe it does already?
@vlimant

Seems the job was just retried on another wn. (Not sure for a reason it to go out from wn, but there might be several only the condor log on schedd would show what happened ) Just for completness, this is the same Job classad below. This raises few more questions if all these memory values get reseted when there was any Shadow exception, like this job has 'NumShadowStarts = 8 '.
 condor_q -pool vocms0815.cern.ch -g 173666.105 -l
MATCH_EXP_JOBGLIDEIN_ResourceName = "CIT_CMS_T2"
RemoteSlotID = 1
StatsLifetimeStarter = 1513
LastRejMatchTime =<PHONE_NUMBER>
JOB_GLIDEIN_ProcId = "$$(GLIDEIN_ProcId:Unknown)"
ChirpCMSSWReadVOps = 18
StreamOut = false
JOB_GLIDEIN_Entry_Name = "$$(GLIDEIN_Entry_Name:Unknown)"
ShadowBday =<PHONE_NUMBER>
MATCH_EXP_JOB_GLIDEIN_SiteWMS_Queue = "cit-gatekeeper3.ultralight.org"
NumRestarts = 0
ChirpCMSSWIOSite_T2_US_Nebraska_ReadBytes = 766292
ExtraMemory = 1200
ChirpCMSSWMaxEvents = -1
MATCH_GLIDEIN_Schedd =<EMAIL_ADDRESS>x509UserProxyVOName = "cms"
UserLogUseXML = true
RecentBlockWriteKbytes = 0
MATCH_GLIDEIN_Site = "Caltech"
MinCores = 3
LastVacateTime =<PHONE_NUMBER>
RecentBlockReadKbytes = 0
LocalUserCpu = 0.0
RemoteUserCpu = 202.0
MATCH_GLIDEIN_Max_Walltime = 171000
MATCH_EXP_JOB_GLIDEIN_ClusterId = "7370919"
JOB_GLIDEIN_SiteWMS_Queue = "$$(GLIDEIN_SiteWMS_Queue:Unknown)"
HasBeenRouted = false
ChirpCMSSWLumis = 0
CMSGroups = "B2G"
MATCH_EXP_x509userproxy = ifThenElse("T2_US_Caltech" =?= "T3_CH_Volunteer",undefined,"/data/certs/myproxy.pem")
CurrentHosts = 1
RecentBlockWrites = 0
MATCH_GLIDEIN_ProcId = 7
x509UserProxyExpiration =<PHONE_NUMBER>
Iwd = "/storage/local/data1/cmsdataops/srv/wmagent/v1.1.18.patch2/install/wmagent/JobCreator/JobCache/pdmvserv_task_B2G-RunIIFall18wmLHEGS-00352__v1_T_190210_045500_7510/B2G-RunIIFall18wmLHEGS-00352_0/B2G-RunIIAutumn18DRPremix-00321_0/JobCollection_852515_0/job_6321522"
MATCH_EXP_JOB_GLIDEIN_Entry_Name = "CMSHTPC_T2_US_Caltech_cit3"
NumShadowStarts = 8
JobPrio = 90000
EstimatedSingleCoreMins = 1500
DiskUsage = 375000
JR_PostJobPrio1 = -4465686701
JR_PostJobPrio2 = -213
ChirpCMSSWReadOps = 162
ChirpCMSSWCPUSpeed = 2117.64
StartdPrincipal =<EMAIL_ADDRESS>CumulativeRemoteUserCpu = 219741.0
JOB_GLIDEIN_ToDie = "$$(GLIDEIN_ToDie:Unknown)"
JobRunCount = 8
Args = ""
MachineAttrSlotWeight0 = 8
JOB_Site = "$$(GLIDEIN_Site:Unknown)"
WantCheckpoint = false
BlockWriteKbytes = 0
ChirpCMSSWFiles = 0
MATCH_EXP_JOB_GLIDEIN_SiteWMS_JobId = "942630.0"
FERMIHTC_OrigPool = "cms_global"
OriginalMaxWallTimeMins = 200
RequestDisk = 11000000
TotalSuspensions = 0
RequestDisk_RAW = 11000000
LastPublicClaimId = "<<IP_ADDRESS>:22242>#1549965801#332#..."
PeriodicRemove = ( JobStatus =?= 5 ) && ( time() - EnteredCurrentStatus > 10 * 60 )
MachineAttrMJF_JOB_HS06_JOB0 = "Unknown"
MATCH_GLIDEIN_CMSSite = "T2_US_Caltech"
RemoteSysCpu = 19.0
MachineAttrGLIDEIN_CMSSite0 = "T2_US_Caltech"
JobCpus = ( ( JobStatus =!= 1 ) && ( JobStatus =!= 5 ) &&  !isUndefined(MATCH_EXP_JOB_GLIDEIN_Cpus) && ( int(MATCH_EXP_JOB_GLIDEIN_Cpus) =!= error ) ) ? int(MATCH_EXP_JOB_GLIDEIN_Cpus) : OriginalCpus
AllowOpportunistic = false
CumulativeRemoteSysCpu = 15640.0
HasPrioCorrection = true
MyType = "Job"
CMSSW_Versions = "CMSSW_10_2_5"
PeriodicHold = false
ResidentSetSize_RAW = 10076628
MachineAttrTotalSlotCpus0 = 8
JOB_GLIDEIN_Job_Max_Time = "$$(GLIDEIN_Job_Max_Time:Unknown)"
MATCH_EXP_JOB_GLIDEIN_Memory = "14700"
Owner = "cmsdataops"
JOB_GLIDEIN_SiteWMS_JobId = "$$(GLIDEIN_SiteWMS_JobId:Unknown)"
ChirpCMSSWIOSite_T2_US_MIT_ReadTimeMS = 6927111
ChirpCMSSWWriteTimeMsecs = 0
WMAgent_RequestName = "pdmvserv_task_B2G-RunIIFall18wmLHEGS-00352__v1_T_190210_045500_7510"
MATCH_GLIDEIN_Entry_Name = "CMSHTPC_T2_US_Caltech_cit3"
RemoteHost = "slot1_1<EMAIL_ADDRESS>LastJobLeaseRenewal =<PHONE_NUMBER>
HasBeenRouted_Overflow = true
RequestResizedCpus = ( Cpus > MaxCores ) ? MaxCores : ( ( Cpus < MinCores ) ? MinCores : Cpus )
MATCH_EXP_JOB_GLIDEIN_CMSSite = "T2_US_Caltech"
WMAgent_SubTaskName = "/pdmvserv_task_B2G-RunIIFall18wmLHEGS-00352__v1_T_190210_045500_7510/B2G-RunIIFall18wmLHEGS-00352_0/B2G-RunIIAutumn18DRPremix-00321_0"
OnExitHold = false
JOB_GLIDEIN_Cpus = "$$(Cpus:0)"
MATCH_EXP_JOB_GLIDECLIENT_Name = "CMSG-v1_0.main"
AccountingGroup = "production.cmsdataops"
MATCH_GLIDEIN_SiteWMS_Slot =<EMAIL_ADDRESS>WantRemoteSyscalls = false
ExitStatus = 0
User = "cmsdataops@cms"
JobLeaseDuration = isUndefined(MachineAttrMaxHibernateTime0) ? 1200 : MachineAttrMaxHibernateTime0
MATCH_GLIDEIN_SEs = "ce3.ultralight.org.org"
MATCH_Memory = 14700
CompletionDate = 0
WhenToTransferOutput = "ON_EXIT"
RequestCpus = WMCore_ResizeJob ? (  !isUndefined(Cpus) ? RequestResizedCpus : JobCpus ) : OriginalCpus
ChirpCMSSWIOSite_T2_US_MIT_ReadBytes =<PHONE_NUMBER>
x509UserProxyFirstFQAN = "/cms/Role=production/Capability=NULL"
CommittedSuspensionTime = 0
MATCH_GLIDEIN_Factory = "SDSC"
JobMachineAttrs = "GLIDEIN_CMSSite"
GlobalJobId = "cmsgwms-submit3.fnal.gov#173666.105#1549980323"
StreamErr = false
ChirpCMSSWIOSite_fnalgov_ReadBytes = 1317207
MachineAttrMaxHibernateTime0 = undefined
MATCH_EXP_JOB_GLIDEIN_Cpus = "8"
Rank = stringlistmember(GLIDEIN_CMSSite,ExtDESIRED_Sites)
JOB_GLIDEIN_SiteWMS = "$$(GLIDEIN_SiteWMS:Unknown)"
TransferInput = "/storage/local/data1/cmsdataops/srv/wmagent/v1.1.18.patch2/install/wmagent/WorkQueueManager/cache/pdmvserv_task_B2G-RunIIFall18wmLHEGS-00352__v1_T_190210_045500_7510/pdmvserv_task_B2G-RunIIFall18wmLHEGS-00352__v1_T_190210_045500_7510-Sandbox.tar.bz2,/storage/local/data1/cmsdataops/srv/wmagent/v1.1.18.patch2/install/wmagent/WorkQueueManager/cache/pdmvserv_task_B2G-RunIIFall18wmLHEGS-00352__v1_T_190210_045500_7510/PackageCollection_0/batch_6321555-0/JobPackage.pkl,/data/srv/wmagent/v1.1.18.patch2/sw/slc7_amd64_gcc630/cms/wmagent/1.1.18.patch2/lib/python2.7/site-packages/WMCore/WMRuntime/Unpacker.py"
JobUniverse = 5
ChirpCMSSWCPUModels = "Intel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz"
MATCH_Cpus = 8
HasBeenReadTuned = true
MATCH_GLIDEIN_ClusterId = 7370919
PeriodicRelease = false
MATCH_EXP_JOB_GLIDEIN_Job_Max_Time = "14400"
JobCurrentStartExecutingDate =<PHONE_NUMBER>
x509userproxy = ifThenElse("$$(GLIDEIN_CMSSite)" =?= "T3_CH_Volunteer",undefined,"/data/certs/myproxy.pem")
MATCH_EXP_JOB_GLIDEIN_ToRetire = "1550162255"
MATCH_EXP_JOB_GLIDEIN_Factory = "SDSC"
TransferQueued = false
Requestioslots = 0
ChirpCMSSWRuns = 0
JOB_GLIDEIN_SEs = "$$(GLIDEIN_SEs:Unknown)"
ChirpCMSSWIOSite_cernch_ReadBytes =<PHONE_NUMBER>
JobNotification = 0
MachineAttrHAS_SINGULARITY0 = true
ProcId = 105
JOB_GLIDEIN_MaxMemMBs = "$$(GLIDEIN_MaxMemMBs:Unknown)"
DESIRED_CMSDataLocations = "T2_US_Caltech"
MATCH_GLIDECLIENT_Name = "CMSG-v1_0.main"
PublicClaimId = "<<IP_ADDRESS>:31829>#1550007027#3#..."
CondorVersion = "$CondorVersion: 8.5.7 Aug 10 2017 $"
ChirpCMSSWReadTimeMsecs = 47645
BlockReadKbytes = 0
BytesRecvd = 109636304.0
Arguments = "pdmvserv_task_B2G-RunIIFall18wmLHEGS-00352__v1_T_190210_045500_7510-Sandbox.tar.bz2 6321522"
ShouldTransferFiles = "YES"
Out = strcat("condor.",ClusterId,".",ProcId,".out")
JOB_GLIDEIN_Memory = "$$(Memory:Unknown)"
NumJobMatches = 8
CumulativeSlotTime = 556465.0
ChirpCMSSWIOSite_T2_US_Nebraska_ReadTimeMS = 14695
OnExitRemove = true
ResidentSetSize = 12500000
JOB_GLIDEIN_Max_Walltime = "$$(GLIDEIN_Max_Walltime:Unknown)"
JobAdInformationAttrs = "JobStatus,QDate,EnteredCurrentStatus,JobStartDate,DESIRED_Sites,ExtDESIRED_Sites,WMAgent_JobID,MachineAttrGLIDEIN_CMSSite0"
In = "/dev/null"
LastJobStatus = 1
CumulativeSuspensionTime = 0
ServerTime =<PHONE_NUMBER>
MemoryUsage = ifthenelse(ProportionalSetSizeKb =?= undefined,( ResidentSetSize + 1023 ) / 1024,( ProportionalSetSizeKb + 1023 ) / 1024)
TotalSubmitProcs = 200
OrigMaxHosts = 1
ProportionalSetSizeKb = 12500000
ChirpCMSSWMaxLumis = 6
TransferIn = false
JOB_GLIDEIN_Name = "$$(GLIDEIN_Name:Unknown)"
WantRemoteIO = true
MATCH_EXP_JOB_GLIDEIN_MaxMemMBs = "20240"
LastRejMatchReason = "no match found "
MATCH_GLIDEIN_ToRetire =<PHONE_NUMBER>
ImageSize = 20000000
orig_FERMIHTC_OrigPool = "cms_global"
JobCurrentStartDate =<PHONE_NUMBER>
x509userproxysubject = "/DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=amaltaro/CN=718748/CN=Alan Malta Rodrigues"
NumJobStarts = 5
ChirpCMSSWMaxFiles = 3
AutoClusterAttrs = "_condor_RequestCpus,_condor_RequestDisk,_condor_RequestMemory,CMSGroups,DESIRED_Gatekeepers,DESIRED_Sites,DynamicSlot,GLIDEIN_USER,JobUniverse,LastCheckpointPlatform,MachineLastMatchTime,MaxWallTimeMins,NONE,NumCkpts,ProportionalSetSizeKb,RequestCpus,RequestDisk,RequestGPUs,RequestMemory,REQUIRED_OS,ResidentSetSize,Slot1_SelfMonitorAge,Slot1_TotalTimeClaimedBusy,Slot1_TotalTimeUnclaimedIdle,WMAgent_AgentName,ConcurrencyLimits,JobStatus,NiceUser,Rank,Requirements,_condor_RequestGPUs,_condor_RequestIoslots,CMS_ALLOW_OVERFLOW,CRAB_UserRole,DESIRED_CMSDataset,DESIRED_Overflow_Region,PartitionableSlot,RequestIoslots,CMS_JobType,DESIRED_USAGE_MODEL,DesiredOS,FERMIHTC_OrigPool,D_FULLDEBUG,x509userproxysubject,_condor_RequestRepackslots,CRAB_UserHN,ParentSlotId,RequestRepackslots,GLIDEIN_STARTEXPR_WALLTIME_FACTOR,x509userproxyfirstfqan,JOB_EXPECTED_MAX_LIFETIME,CondorLoadAvg,Memory,GLIDEIN_PS_HAS_SINGULARITY,GLIDEIN_ToRetire,SiteWMS_WN_Preempt,Installing,EstimatedSingleCoreMins,ExtDESIRED_Sites,ExtraMemory,JobCpus,MATCH_EXP_JOB_GLIDEIN_Cpus,MaxCores,MinCores,OriginalCpus,OriginalMaxWallTimeMins,OriginalMemory,RequestResizedCpus,WMCore_ResizeJob"
Cmd = "/data/srv/wmagent/v1.1.18.patch2/sw/slc7_amd64_gcc630/cms/wmagent/1.1.18.patch2/etc/submit.sh"
BlockReads = 0
JobStartDate =<PHONE_NUMBER>
NumJobCompletions = 0
LastMatchTime =<PHONE_NUMBER>
MATCH_EXP_JOB_GLIDEIN_ToDie = "1550176655"
JOB_GLIDEIN_CMSSite = "$$(GLIDEIN_CMSSite:Unknown)"
JOBGLIDEIN_ResourceName = "$$([IfThenElse(IsUndefined(TARGET.GLIDEIN_ResourceName), IfThenElse(IsUndefined(TARGET.GLIDEIN_Site), IfThenElse(IsUndefined(TARGET.FileSystemDomain), \"Local Job\", TARGET.FileSystemDomain), TARGET.GLIDEIN_Site), TARGET.GLIDEIN_ResourceName)])"
CoreSize = -1
CMS_JobType = "Processing"
MATCH_EXP_JOB_GLIDEIN_Schedd =<EMAIL_ADDRESS>TargetType = "Machine"
TransferOutput = "Report.0.pkl,wmagentJob.log"
CommittedSlotTime = 0
JobStatus = 2
x509UserProxyEmail =<EMAIL_ADDRESS>RemoteWallClockTime = 143040.0
NumSystemHolds = 0
OriginalCpus = 8
LastRemoteHost = "slot1_2<EMAIL_ADDRESS>MATCH_EXP_JOB_GLIDEIN_Name = "gfactory_instance"
AcctGroup = "production"
JOB_GLIDEIN_Site = "$$(GLIDEIN_Site:Unknown)"
Requirements = ( ( REQUIRED_OS =?= "any" ) || ( GLIDEIN_REQUIRED_OS =?= "any" ) || stringListMember(GLIDEIN_REQUIRED_OS,REQUIRED_OS) ) && ( AuthenticatedIdentity =!=<EMAIL_ADDRESS>) && TARGET.OPSYS == "LINUX" && TARGET.ARCH == "X86_64" && TARGET.HasFileTransfer && TARGET.Disk >= RequestDisk && TARGET.Memory >= RequestMemory
RequestRepackslots = 0
DESIRED_Sites = "T2_US_Caltech"
RecentBlockReads = 0
NumCkpts = 0
StartdIpAddr = "<<IP_ADDRESS>:31829?CCBID=<IP_ADDRESS>:9696%3faddrs%3d<IP_ADDRESS>-9696#305380%20<IP_ADDRESS>:9646%3faddrs%3d<IP_ADDRESS>-9646#218696&addrs=<IP_ADDRESS>-31829&noUDP>"
CMS_ALLOW_OVERFLOW = "False"
DiskUsage_RAW = 371781
ChirpCMSSWElapsed = 0
ChirpCMSSWEvents = 0
MaxHosts = 1
MATCH_EXP_JOB_GLIDEIN_ProcId = "7"
REQUIRED_OS = "rhel6"
MATCH_EXP_JOB_GLIDEIN_SEs = "ce3.ultralight.org.org"
MATCH_EXP_JOB_GLIDEIN_Max_Walltime = "171000"
JOB_GLIDEIN_SiteWMS_Slot = "$$(GLIDEIN_SiteWMS_Slot:Unknown)"
CondorPlatform = "$CondorPlatform: X86_64-CentOS_7.3 $"
ChirpCMSSWEventRate = 0
WMAgent_JobID = 6321522
BlockWrites = 0
ChirpCMSSWDone = false
AcctGroupUser = "cmsdataops"
ImageSize_RAW = 19652428
MATCH_GLIDEIN_Job_Max_Time = 14400
EstimatedSingleCoreMins_RAW = 1440
OriginalMemory = 14700
JOB_GLIDECLIENT_Name = "$$(GLIDECLIENT_Name:Unknown)"
LocalSysCpu = 0.0
ProportionalSetSizeKb_RAW = 10075126
LastSuspensionTime = 0
MATCH_GLIDEIN_SiteWMS_Queue = "cit-gatekeeper3.ultralight.org"
RecentStatsLifetimeStarter = 1200
DESIRED_CMSPileups = "/Neutrino_E-10_gun/RunIISummer17PrePremix-PUAutumn18_102X_upgrade2018_realistic_v15-v1/GEN-SIM-DIGI-RAW"
MATCH_EXP_JOB_GLIDEIN_Site = "Caltech"
WMAgent_AgentName = "WMAgentCommissioning"
UserLog = strcat(Iwd,"/condor.",ClusterId,".",ProcId,".log")
JOB_GLIDEIN_Factory = "$$(GLIDEIN_Factory:Unknown)"
MachineAttrCpus0 = 8
QDate =<PHONE_NUMBER>
x509UserProxyFQAN = "/DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=amaltaro/CN=718748/CN=Alan Malta Rodrigues,/cms/Role=production/Capability=NULL,/cms/Role=NULL/Capability=NULL,/cms/uscms/Role=NULL/Capability=NULL"
Err = strcat("condor.",ClusterId,".",ProcId,".err")
MaxCores = 15
Pre_DESIRED_Sites = "T2_US_Caltech"
EstimatedInputRateKBs = 600
WMAgent_PostJobPrio1 = -1
AutoClusterId = 305422
WMAgent_PostJobPrio2 = -44657
PostJobPrio1 = JR_PostJobPrio1
ChirpCMSSWTotalCPU = 191.657
ChirpCMSSWReadSegments = 968
PostJobPrio2 = JR_PostJobPrio2
ExitBySignal = false
PeriodicRemoveReason = PeriodicRemove ? "Job automatically removed for being in Held status" : ""
MachineAttrDIRACBenchmark0 = 8.56648851608
MATCH_EXP_JOB_Site = "Caltech"
BufferBlockSize = 32768
ClusterId = 173666
ChirpCMSSWReadBytes = 2384268
BytesSent = 0.0
DelegatedProxyExpiration =<PHONE_NUMBER>
JobLastStartDate =<PHONE_NUMBER>
MATCH_GLIDEIN_MaxMemMBs = 20240
ChirpCMSSWWriteBytes = 0
RequestMemory = OriginalMemory + ExtraMemory * ( WMCore_ResizeJob ? ( RequestCpus - OriginalCpus ) : 0 )
EnteredCurrentStatus =<PHONE_NUMBER>
MATCH_GLIDEIN_SiteWMS = "HTCondor"
JOB_GLIDEIN_ToRetire = "$$(GLIDEIN_ToRetire:Unknown)"
MATCH_GLIDEIN_SiteWMS_JobId = "942630.0"
BufferSize = 524288
JOB_GLIDEIN_Schedd = "$$(GLIDEIN_Schedd:Unknown)"
LeaveJobInQueue = false
MaxWallTimeMins = WMCore_ResizeJob ? ( EstimatedSingleCoreMins / RequestCpus + 15 ) : OriginalMaxWallTimeMins
MATCH_EXP_JOB_GLIDEIN_SiteWMS_Slot =<EMAIL_ADDRESS>NumCkpts_RAW = 0
DESIRED_Archs = "INTEL,X86_64"
MinHosts = 1
JOB_GLIDEIN_ClusterId = "$$(GLIDEIN_ClusterId:Unknown)"
MATCH_GLIDEIN_Name = "gfactory_instance"
ExtDESIRED_Sites = "T2_US_Caltech"
MATCH_GLIDEIN_ToDie =<PHONE_NUMBER>
OriginalMaxWallTimeMins_RAW = 180
TransferringInput = false
ChirpCMSSWIOSite_cernch_ReadTimeMS = 7126154
ChirpCMSSWIOSite_fnalgov_ReadTimeMS = 11416
WMCore_ResizeJob = true
CMS_JobRetryCount = 0
DESIRED_CMSDataset = undefined
NiceUser = false
ChirpCMSSWLastUpdate =<PHONE_NUMBER>
RootDir = "/"
LastVacateTime_RAW =<PHONE_NUMBER>
CommittedTime = 0
MATCH_EXP_JOB_GLIDEIN_SiteWMS = "HTCondor"

@jamesletts @vlimant fyi